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Abstract 

We consider (in the framework of algorithmic information theory) questions of the 
following type: construct a message that contains different amounts of information for 
recipients that have (or do not have) certain a priori information. 

Assume, for example, that the recipient knows some string a, and we want to send 
her some information that allows her to reconstruct some string b (using a). On the other 
hand, this information alone should not allow the eavesdropper (who does not know a) to 
reconstruct b. It is indeed possible (if the strings a and b are not too simple). 

Then we consider more complicated versions of this question. What if the eavesdropper 
knows some string c? How long should be our message? We provide some conditions that 
guarantee the existence of a polynomial-size message; we show then that without these 
conditions this is not always possible. 

1 Non-informative conditional descriptions 

In this section we construct (for given strings a and b that satisfy some conditions) a string 
/ that contains enough information to obtain b from a, but does not contain any information 
about b in itself (without a), and discuss some generalizations of this problem. 

Uniform and non-uniform complexity 

Let us start with some general remarks about conditional descriptions and their complexity. 
Let X be a set of binary strings, and let j be a string. Then C{X — )■ y) can be defined as the 
minimal length of a program that maps every element of X to y. (As usually, we fix some 
optimal programming language. We can also replace minimal length by minimal complexity.) 
Evidently, 

CiX^y) >maxC(y|jc) 

(if a program p works for all x G X, it works for every x), but the reverse inequality is not 
always true. It may happen that the "uniform" complexity of the problem X ^ y (left hand 
side) is significantly greater than the "nonuniform" complexity of the same problem (right 
hand side). 



*This paper contains some results of An. A. Muchnik (1958-2007) reported in his talks at the Kolmogorov 
seminar (Moscow State Lomonosov University, Math. Department, Logic and Algorithms theory division, March 
11, 2003 and April 8, 2003) but not published at that time. These results were stated (without proofs) in the joint 
talk of Andrej Muchnik and Alexei Semenov at Dagstuhl Seminar 03181, 27.04.2003-03.05.2003. This text was 
prepared by Alexey Chernov and Alexander Shen in 2008-2009. 
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To prove this, let us consider an incompressible string y of length n and let X be the set 
of all strings x such that C(j|jc) < n/2. Then the right hand side is bounded by n/2 by con- 
struction. Let us show that left hand side is greater than n — 0{\o%n). Indeed, let p be a 
program that outputs y for every input x such that C{y\x) < n/2. Among those x there are 
strings of complexity n/2 + 0{\ogn) and together with p they are enough to obtain y, there- 
fore C{y\p) <n/2-\- 0{\o%n). Therefore, there exists a string e of length 0{\o%n) such that 
C{y\ {p, e)) < n/2. Then, by our assumption, p{{p, e)) = y and therefore the complexity of p is 
at least n — OiXogn). 

Remark. In this example the set X can be made finite if we restrict ourselves to strings of 
bounded length, say, of length at most 2n. 

Complexity of the problem {a^b) b 

The example above shows that uniform and nonuniform complexities could differ significantly. 
In the next example they coincide, but some work is needed to show that they coincide. 

Let a and b be binary strings. By (a — t- b) we denote the set of all programs that transform 
input a into output b. It is known |[2l that 

C{{a^b)^b)=mm{C{a),C{b))+0{\ogN) 

for any two strings a, b of length at most N. It turns out that a stronger version of this statement 
(when the uniform complexity is replaced by a non-uniform one) is also true: 

Theorem 1 For every two strings a and b of length at most N there exists a program f that 
maps a to b such that 

Cib\f)=mm{C{a),C{b)} + 0{\ogN) 

Proof. Note that <-inequality is obviously true for any program / that maps a to b. Indeed, 
having such a function and any of the strings a and b, we can reconstruct b. 

Let us prove that the reverse inequality is true for some function / that maps a to b. We 
restrict ourselves to total functions defined on the set of all strings of length at most n and whose 
values also belong to this set, so such a function is a finite object and conditional complexity 
with respect to / is defined in a natural way. Note also that (up to 0(logA'^) precision) it does 
not matter whether we consider / as an explicitly given finite object or as a program, since (for 
known A'^) both representations can be transformed to each other. 

Let m be the maximum value of C{b\f) for all functions (of the type described) that map 
a to b. We need to show that one of the strings a and b has complexity at most m + 0{logN). 
This can be done as follows. 

Consider the set S of all pairs (a', b') where a' and b' are strings of length at most that have 
the following property: C{b'\f) < mfor every total function f whose arguments and values are 
string of length at most N and f{a') = b'. By the definition of m, the pair {a,b) belongs to S. 

The set S can be effectively enumerated given m and A^^. Let us perform this enumeration 
and delete pairs whose first or second coordinate was already encountered (as the first/second 
coordinate of some other undeleted pair during the enumeration); only "original" pairs with 
two "fresh" components are placed in S. This guarantees that 5 is a graph of a bijection. The 
pair (a, b) is not necessarily in 5; however, some other pair with the first component a or with 
the second component bis'mS (otherwise nothing prevents {a,b) from appearing in S). 



2 



Since S can also be effectively enumerated (given m and A'^), it is enough to show that 
it contains 0(2"') elements (then the ordinal number of the above-mentioned pair describes 
either aoxb). 

To show this, let us extend S to the graph of some bijection g. If some {a' ,b') E S, then 
g{a') = y and therefore C{b'\g) < m by construction (recall that 5 is a subset of S). Therefore, 
S contains at most 0(2'") different values of b' , but 5 is a bijection graph. (End of proof.) 

Cryptographic interpretation 

Theorem [H has the following "cryptographic" interpretation. We want to transmit some infor- 
mation (string b) to an agent that already knows some "background" string a by sending some 
message /. Together with a this message should allow the agent to reconstruct b. At the same 
time we want / to carry minimal information about b for a "non-initiated" listener, i.e., the 
complexity C{b\f) should be maximal. This complexity cannot exceed C{b) for evident rea- 
sons and cannot exceed C{a) since a and / together determine b. Theorem [T] shows that this 
upper bound can be reached for an appropriate /. 

Let us consider a relativized version of this result that also has a natural cryptographic inter- 
pretation. Assume that non-initiated listener knows some string c. Our construction (properly 
relativized) proves the existence of a function / that maps aiob such that 

C{b\f,c)^mm{C{a\c),C{b\c)). 

This function has minimal possible amount of information about b for people who know c. 
More formally, the following statement is true (and its proof is a straightforward relativization 
of the previous argument): 

Theorem 2 Let a, b, c be strings of length at most N. Then there exists a string f such that: 
{\)C{b\aJ) = 0{\ogN)- 
(2) C{b\cJ)=mm{C{a\c),C{b\c)} + 0{\ogN). 

The claim (1) says that for recipients who know a the message / is enough to reconstruct 
b\ the claim (2) says that for the recipients who know only c the message / contains minimal 
possible information about b. 

Remark. One may try to prove Theorem[T]as follows: let / be the shortest description of b 
when a is known; we may hope that it does not contain "redundant" information. However, this 
approach does not work: if a and b are independent random strings of length n, then b is such 
a shortest description, but cannot be used as / in Theorem[T] In this case one can f = a®b 
(bit-wise sum modulo 2) instead: knowing / and a, we reconstruct b = a® f, but C{b\f) ~ n. 

This trick can be generalized to provide an alternative proof for Theorem [U For this we use 
the conditional description theorem from (jT]. It says that 

for any two strings a, b of length at most N there exist a string b' such that 

• C{b\a,b') = 0{\ogN) [b' is a description of b when a is known], 

• C{b'\b) = 0{logN) [b' is simple relative to b] and 

• the length of b' is C{b\a) [b' has the minimal possible length for descriptions 
of b when a is known]. 
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To prove Theorem [H take this b' and also a' defined in the symmetric way (the short de- 
scription of a when b is known simple relative to a). Add trailing zeros or truncate a' to get the 
string a" that has the same length as b' . (Adding zeros is needed when C{a) < C{b), truncation 
is needed when C(a) > C{b) .) Then let f = a" ® b'. 

A person who knows a and gets /, can compute (with logarithmic additional advice) first 
a', then a", then b' and then b. It is not difficult to check also that C{b\f) = min{C(a), C(Z?)} 
with logarithmic precision. 

Indeed, 

c{b\f) = c{bj\f) = c{b,yj\f) = c{by\f) > 

> C{b, a") - C{f) > C{b, a") - \f\ = C{b, a") - C{b\a) 

with logarithmic precision. The strings a' and b are independent (have logarithmic mutual 
information), so b and a" (that is a simple function of a') are independent too. Then we get 
lower bound C{b) — C{b\a) +C{a") which is equal to min{ C(a), C(^)}. (End of the alternative 
proof.) 

The advantage of this proof: it provides a message / of polynomial in N length (unlike 
our original proof, where the message is some function that has domain of exponential size), 
and, moreover, / has the minimal possible length C{b\a). The result it gives can be stated as 
follows: 

Theorem 3 For every two strings a and b of length at most N there exists a string f of length 
C{b\a) such that 

C{b\f,a) = 0{\ogN) 

and 

C{b\f)=mm{C{a),C{b)} + 0{\ogN). 

The disadvantage is that this proof does not work for relativized case (Theorem [2]), at least 
literally. For example, let a and b be independent strings of length In and let a = aiaa and 
b = b\b2 be their divisions in two halves. Then let c = (ai © a2 © ^i)(^^2 © ©^2)- Then 
C{a\c) = C{a,c\c) = C{a,b\c) = 2n, C{b\c) = 2n, but C{b\c,a(Bb) — 0. 

In the next section we provide a different construction of a short message / that has the 
required properties (contains information about b only for those who know a but not for those 
who know c). 

2 A combinatorial construction of a low complexity 
description 

We will prove that if a contains enough information (more precisely, if C{a\c) > C{b\c) + 
C{b\a) + 0{logN)), then there exists a message / that satisfies the claim of Theorem |2l and has 
complexity C{b\a) + 0{\ogN). We need the following combinatorial statement. (By we 
denote the set of k-hit binary strings.) 
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Combinatorial statement 

Lemma 1 Let n>mbe two positive integers. There exists a family ^ consisting of2'"poly{n) 
functions of type M" — t- B™ with the following property: for every string b G B*" and for every 
subfamily that contains at least half of the elements of ^ , there are at most 0(2"'') points 
with the second coordinate b and not covered by the graphs of the functions in ^' . 

Formally the property of ^ claimed by Lemma (Fig.[T]) can be written as follows: 

V&V^' C ^ [#^' > =^ #{a G B" I f{a) ^ b for all f e = 0(2")] . 

(Note that the condition n > m is in fact redundant: if n < m, the claim is trivial since the 
number of all a is 0(2'").) 

Before proving the Lemma, let us try to explain informally why it could be relevant. The 
family ^ is a reservoir for messages (/ will be a number of some function from Most 
functions from ^ (as in any other simple family) have almost no information about b; they 
form If the pair {a,b) is covered by the graph of some function / G then / (i.e., 
its number) is the required message. If not, a belongs to a small set of exceptions, and its 
complexity is small, so the condition of the theorem is not satisfied. (See the detailed argument 
below.) 




b 
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Figure 1: Some functions (up to 50%) are deleted from nevertheless the graphs of the 
remaining ones cover every horizontal line almost everywhere (except for 0(2™) points). 

Proof of the combinatorial lemma. We use probabilistic method and show that for a random 
family of 2' independent random function the required property holds with positive probability. 
(The exact value of parameter t will be chosen later.) 

Let us upperbound the probability of the event "random family ^i, . . . , 92' does not satisfy 
the required property". This happens if there exist 

• an element b G B'"; 

• a set 5 C B" that contains s2'^ elements (the exact value of the constant s will be chosen 
later); 

• a set / C { 1 , 2, . . . , 2' } that contains half of all indices 
such that 

(Pi{a) 7^ b for every a G 5 and every / G /. (*) 
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To get an upper bound for the probability of this event, note that there are 2*" different values 
of b, at most 2^ different values of I and at most (2")'*^ different values of S. For fixed b, I, 
and S the probability of (*) is 

^ 2™ 

(each of 2'^^ functions with indices belonging to / has a value different from b at each point 
a e 5). In total we get an upper bound 



m 



2 

and we have to show that this product is less than 1 if the values of the parameters are chosen 
properly. We can replace (1 — 1 /2'")-^ by 1/e (the difference is negligible with our precision) 
and rewrite the expression as 

The most important terms are those containing 2' and 2'" in the exponents (since 2^,2"* » 
m,n,s). We want the last small term to overweight the first two. Let us split it into two parts 
(1/2)^^'/^ and use these parts to compensate the first and the second term. It is enough that 

2'«+2'. (1/^)^274^1 

and 

2-2'".(l/e)-^-2'/4<i 

at the same time. The first inequality can be made true if the constant s is large enough (note 
that m<^2'). The second inequality (where both exponents can be divided by s) is achievable 
with2f = 2"'poly(n). □ 

Main result 

Now we are ready to give the formal statement and proof: 

Theorem 4 There exists a constant d such that for any strings a,b,c of length at most N satis- 
fying the inequality 

C{a\c) > C{b\c) + C{b\a) +d\ogN 

there exists a string f of length at most C{b\a) +d\ogN such that C{b\a,f) < dlogN and 
C{b\cJ) > C{b\c) - dlogN. 

Recall the intuition behind this result. The condition of the theorem guarantees that the 
agent's "background" a has enough information not available to the adversary (who knows c); 
theorem guarantees that there exists a string / that allows the agent to reconstruct b from a, 
has the minimal possible length among all strings with this property and does not provide any 
information about b if the adversary knows only c. (Note that we use the same constant d in 
all O(logA^) expressions, but this does not matter since increasing d makes the statement only 
weaker.) 
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Proof. Using conditional description theorem (T\, we find string b' of length C{b\a) such 
that both complexities C{b\b',a) and C{b'\b) are 0(logA'^). Then we apply the combinatorial 
lemma with n equal to the length of a and m equal to the length of b', i.e., to C{b\a) . The lemma 
provides a family and we may assume without loss of generality that the complexity of ^ 
is 0{\ogN) (for given m and n, take the first family with the required properties in some fixed 
ordering). 

Most functions in ^ (as well as most objects in any simple set) do not have much informa- 
tion about b when c is known, i.e., the difference C{b\c) — C{b\f,c) is small for most / G 
Indeed, with logarithmic precision this difference can be rewritten as C(/|c) — C{f\b,c) (re- 
call the formula for pair and conditional complexities), and the average value of both terms 
in the last expression is m + 0{logN), the difference is of order 0{logN) and we can use the 
Chebyshev inequality. 

Let be functions from this majority. The lemma guarantees that the graphs of those 
functions cover all pairs {a',b') for all strings a' of length n except for 0(2™) "bad" values of 
a', and it remains to show that the given string a is not "bad". It is because 

C{a\c) < C{b\c) + C{b\a) + 0{\ogN) 

for all "bad" a'. Indeed, knowing b, c and C{b\c) (the latter contains O(logA^) bits and can 
be ignored with logarithmic precision), we can enumerate all functions / that do not belong 
to (=functions that make complexity of b with condition c smaller), and therefore we can 
enumerate all 0(2'") "bad" values. (Note also that b' can also be obtained from b with a 
logarithmic advice.) So the complexity of the "bad" values (for known b and c) is at most 
m + 0(logA^): 

C{a'\b, c) < C{b\a) -f O(logA^) 

for all "bad" a' , therefore 

C{a\c) < C{a'\b,c) + C{b\c) + 0{\ogN) < C{b\a) + C{b\c) + 0{\ogN) 
as we claimed. □ 

3 Negative result and open questions 

Theorem m makes an assumption that looks artificial at first: for example, if a, b, c are pairwise 
independent, we require C{a) to be twice as big as C{b), and it is intuitively unclear why 
the amount of the background information should be twice as big as the message we want 
to transmit (inequality C{a) > C{b) looks more natural). In this section we show that this 
condition, even if looking artificial, is important: without it, all the strings / that satisfy the 
claim of Theorem |2] may have exponentially large length. The exact statement (see Theorem [5] 
below) and its proof are rather technical, so let us start with a simplified example, where, 
unfortunately, we get a string c of large complexity. Then we explain the more advanced 
example that does not have this problem. 

Let us construct three strings a,b,c with the following properties: every reasonably long 
program / (of polynomial or subexponential length) that maps a to b can be used to simplify 
the transformation of c into b. In our example the string a has complexity 1 .3n, the string b has 
complexity n, and they are mutually independent (have logarithmic mutual information). (The 



7 



coefficient 1.3 is chosen arbitrarily; it is important that 1.3 is greater than 1 and less than 2. 
The complexity of b when c is known will be about n, so using c as a condition does not make 
b simpler. But if we add to c any program / that maps a to b, it becomes possible to obtain 
a using only 0.3n bits of advice: the conditional complexity decreases from C{b\c) ^ n to 
C{b\f,c)^0.3n. 

The main idea of this example can be explained as follows: the string c itself encodes a 
function that maps ato b (but still c without a has no information about b). Assume that some 
program / that maps a to b is given. Why does it help to describe if c is known in addition to 
/? We know that both / and c map a to b, so a is one of the solution of the equation f{x) = c{x) . 
If this equation has not too many solutions, we can describe a (and therefore b) by specifying 
the ordinal number of a in the enumeration of all solutions. (Note that / may be not everywhere 
defined, but this does not matter.) In this way we get a conditional description of b (for known 
c and /) that may have small length compared to C{b) (and C{b) will be close to C{b\c); we 
promised that c itself has no information about b). 

How do we get a, b, and c with these properties? We get such a triple with high probability 
if a and b are independently taken at random among strings of length 1.3n and n respectively, 
and c is a random function whose graph contains pair {a,b). The same distribution on a,b,c 
can be described in a different way: we take a random function c and then a random element 
{a,b) of its graph. 

With high probability we get strings a and b with the required complexities l.3n and n and 
small mutual information. We can also show that C{b\c) is close to n with high probability. 
Indeed, for a typical function c of type B^'^" — )• B" most of its values have preimage of size 
20.3n^ and therefore the second component of a random element of its graph has almost uniform 
distribution, so most of the values of c have high complexity even with condition c. 

Now let / be some program that maps a and b and has not very high complexity (much 
less than what Theorem [2] gives). How many solution has the equation f{x) = c{x)l Typically 
(for a given / and a random c) we have about 2^^^" solutions (for each x the probability of 
f{x) = c{x) equals 2^'\ and there are 2^-^" points x); here we assume that / is total, but if it 
is not, we get even less solutions. For a fixed / and a random c, it is very unlikely that the 
number of solutions is significantly greater than 2^-^". In other words, Hamming ball of the 
corresponding radius around / has a negligible probability. If the number of these balls (i.e., 
the number of programs / we consider) is not too large, the union of these events also has 
small probability, so a randomly chosen c will be outside these balls. This means that for all 
programs / with bounded complexity the equation f{x) = c(x) has at most 2°-^" solutions (or 
slightly more) and the complexities C(a|/, c) and C{b\f, c) are (almost) bounded by 0.3n as we 
promised. 

We do not provide details of this argument since we want to prove a stronger (and more 
complicated) results. Namely, we want to find a function c that has not very high complexity 
(and the argument explained gives c that can have exponential complexity): the complexity of 
c should exceed the complexity of programs / (that it opposes) by C{b) . (If we allow more 
programs, we need more freedom for c.) 

The idea of the construction remains the same: we select a random point on the graph 
of a random function. However, now the function is a random element of some family ^ of 
functions. We formulate some combinatorial properties of ^. Then we prove (by a probabilistic 
argument) that there exists a family with these properties and conclude that there exists a simple 
family with these properties (the first family found by exhaustive search). Finally, we prove that 
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for most pairs (a, b) there exists a function c in the family that satisfies our requirements. (So 

we prove even a bit stronger statement: instead of existence of a triple a,b, c we prove that for 
most a and b there exists c.) The size of the family provides a bound for the complexity of c 
(since every element of ^ is determined by its index). 

Let us formulate the required combinatorial statement starting with some definitions. Fix 
some sets A and B. We say that some family ^ of functions A — )■ 5 rejects a function c : A — > 5 
if there exists / G ^ such that the cardinality of the set {a: c{a) = f{a)} exceeds 4#A/#B 
(note that the "expected" cardinality is #A/#B). Let be a mapping defined on B; for every 
b e B the value S){b) is a family of functions of type A — )• (i.e., S^{b) C B"^ for every b e B). 
We say that a function c covers the pair (a, Z?) e A x 5 (for given and ^) if (1) c{a) = 
(2) the function c is not rejected by ^ and (3) c ^S){b). 

Lemma 2 Ai'i'Mme ^/za? #B >2 and #A > 1 6#B. Assume that two numbers £ > 4#B / #A and 
(j) < 2*^/(4#^) are fixed. There exists a family ^ of functions A — )■ B of cardinality 

fM,6*.#B.,og,(#B)} 

with the following property: for every family ^ of size at most ^ and for every mapping ^ such 
that #{S){b)) < (l/4)#'^/or every b & B, at most e-fraction of all pairs {a,b) are not covered 
by any c e ^ (for these ^ and ff). 

The statement of this lemma can be written as follows (we omit conditions for cardinalities 
of^, ^andio(&)): 



max 



3<^ V^,iD 



(ci^b) : Vc 



(c(a) = b)^ [(c e m) V (3/ e : f{x) = c(x)} > ^)] 



< 



<e-#A-#B. 



Let us explain informally the meaning of this lemma (how it is used in the sequel). We 
may assume without loss of generality that the family is simple (looking for the first family 
with the required properties in some ordering). Let ^ be the family of all functions that have 
simple programs (or their extensions, if the functions are partial). Let Sj{b) be the set of all 
functions that are simple when b is known (having small conditional complexity with condition 
b). For a pair {a,b) that does not belong to the "bad" e-fraction, there exists a function c e ^ 
that covers (a^b). This function (or, better to say, its index in ^) is a counterexample we are 
looking for. Indeed, if the eavesdropper knows c and gets a simple program / mapping a to 
b, the complexity of b for her decreases. Indeed, it is enough to specify the ordinal number 
of a in the enumeration of all solutions of the equation f{x) = c{x), and the eavesdropper can 
reconstruct a (and therefore b, since f{a) = b). On the other hand, the choice of S) guarantees 
that c and b are independent (i.e., c has maximal possible complexity even if b is known). The 
details of these argument will be explained later, after we prove the lemma. 

Proof of the lemma. Using a probabilistic argument, let us consider a random family ^ of 
the size mentioned. We assume that ^ is indexed by integers in range 1. . . #^, and for every 
index / and every point a e A the value of ith function on a is an independent random variable 
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uniformly distributed over B. Then we prove that the probability of the event is bad" (i.e., 

does not have the required property) is strictly less than 1. 

For this we get an upper bound for the probability of the event '"^ does not have the required 
property" with respect to a fixed family ^ (and then multiply it by the number of different 
families ^). So let us assume ^ is fixed. Things are "good" if for every mapping S^{b) 
(with our restrictions: all S){b) have cardinality at most (l/4)#'^) for e-almost all pairs (a,&) 
there is a function c G that is not rejected by and is not 'mS){b) such that c{a) = b. 

Note that the definition of rejection does not refer to : the set of rejected function is 
determined by ^ alone. For a given ^ there are two possibilities: (1) many functions are 
rejected (we choose (l/4)#^ as a threshold) or (2) not many functions are rejected. In the 
latter case we may add rejected functions to 3AlS^{b) (for all b), and the size of all remains 
bounded by (l/2)#^. 

In other term, for a fixed ^ the "bad" event is covered by the union of the following two 
events: 

1. ^ rejects at least 1/4 of all functions in ^; 

2. there exists a mapping b^-^ S^{b) where all sets S){b) have cardinality at most (l/2)#'^ 
such that the fraction of pairs {a,b) e Ax B that do not belong to any function c e 
'^\Sj{b) exceeds e. 

What we need is the following: the sum of the probabilities of these two events multiplied 
by the number of possibilities for ^ is less than 1. To show this, we prove that each of these 
two probabilities is less than 1/2 divided by (#5*"*)* (this expression is an upper bound for the 
number of different families C B^ of size <i>). 

The first event can be rewritten as follows: there exists a subfamily ^' of size /A 
such that for all c e there exists A' <Z A of size 4#A/#B and a function / e =^ such that 
f{a) = c{a) for all a G A'. 

The number of possibilities for 'rf' does not exceed 2*^, the number of all subsets. For a 
fixed (or, better to say, for a fixed set of indices) the functions with these indices are chosen 
independently. So we can estimate the probability of the bad event for one index and then use 
independence. To get an upper bound for the number of possibilities for A' let us note that the 
number of r-element subsets of a ^-element set, [fj, does not exceed q''/r\ < /{{r/3y) = 
{3q/rY. For ^ = #A and r = 4#A/#B we get the bound (3#5/4)4#'4/*^. 

Therefore, the probability of the first event does not exceed 

Multiplied by (#5)*"^'* (the number of possibilities for this probability is less than 1/2, 
since #5 > 2, #A > 16#5, $ < 2*'^/4#^, and #'*^ > 6* ■ #5 ■ log2(#5) (according to lemma's 
assumptions). Indeed, the last inequality implies that #'^^ > 12 if 4> > 1 (for empty ^ the 
statement is trivial). Since #5 > 2, we conclude that 1 +#^ < 13#^/12. Then 1 < #A/(16#fi) 
implies that 1 < (13/192)(#A ■ #C/#B). The condition log24> < #A/4#B implies that 
(#^/4)log2 4> < {I / 16) {#A-#'rf /#B). Finally, the inequality #^ > 64) • #5 • log2#5 implies 
that #A • <I>log2#5 < (1/6) (#A • #^/#B). Adding these inequaUties (note that 19/64 < 1/3 < 
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log2(4/3) and taking the exponent (with base 2) of both sides, we get the required inequaUty 

(after appropriate grouping of the factors). 

Now let us consider the second event (recall that it depends on ^ which is fixed): there exist 
a mapping b^S){b) such that every S){b) has cardinality at most #^ /I and a subset U cAxB 
of size e-#A-#B such that for every pair {a,b) e U and for every function c e ^\S){b) we 
have c{a) ^ b. 

In the sequel we assume that S) (b) is not a set of functions, but a set of their indices (numbers 
in 1 . . . range); this does not change the event in question. 

To estimate the probability of the second event, let us fix not only ^ but also and U. The 
corresponding event can be described as the intersection (taken over all pairs (a, b) and over 
all / ^ S){b)) of the events c[i] (a) ^ b ("the ith function does not map a to b"). The probability 
bound would be simple if all these events were independent; in this case the probability would 
be (1 — 1 /#BY, where d is the number of all triples {i,a,b), i.e., e ■#A-#B ■#'^ /2 (i.e., d is the 
product of the number of pairs (a, b) e U and the number of possible values of i for given b). 

Unfortunately, these events are independent only for different a (or different /); the events 
c[i] (a) ^ b\ and c[/] (a) ^ &2 are dependent. However, the dependence works in the "helpful" 
direction: the condition c[i\ (a) ^ b\ only increases the probability of the event c[i\ (a) ^ b2 (the 
denominator in 1/#B decreases by 1). The same is true for several conditions. 

Formally speaking, we may group the events with common a and i and then use the in- 
equality ( 1 — k/#B) < ( 1 — 1 / #B)^, where k is the number of events in a group. 

In this way we get an upper bound for the probability of failure: for fixed and U, it 
does not exceed 

/ 1 \ E-#A-#B-#^/2 

\ #bJ 

This expression is then multiplied by the number of possibilities for U (that does not exceed 
2#A #fl^^ for Sj (that does not exceed (2*"^)*^) and for ^. In total, we get 

2-e-#A-#^/2 . 2#'4-#fi . 2#^-#5 . (#5)*'^l'* 

It is easy to check that this expression is less than 1/2 if #fi > 2, e > 4#B/#A, #^ > 20#B/e, 
and > (64>log2#5)/e. Indeed, we have 1 +#A • #5 < 3 • #A • #5/2 if A is not empty and 
#5 > 2. Therefore, #^ > 20 ■ #B/e implies 1 + #A ■ #5 < (3 /40)e ■ #A ■ #^. Also e > 4#B/#A 
implies ■ #5 < ( 1 /4)e ■ #A ■ #^. Finally, ¥if > (6$log2#5)/e impUes #A ■ 4> ■ log2(#5) < 
{l/6)e-#A ■#'^. Adding these inequalities, noting that 59/120 < 1/2 and then taking the 
exponents (with base 2), we get the required bound after regrouping the factors. 
Lemma is proven. 

Now we use this lemma to prove the promised negative result. Let a > be some constant. 
Let m, n, / be positive integers such that n> I, m>n + 4, m — a log2m > n + 2, and / + 1 + 
log2(/+l) <2'"-«-2. LetA^ = max{m,/}. 

Theorem 5 Let a be a string of length m and let b be a string of length n such that 

m + n — C^ {a,b) < alog2m. 
Then there exists a string c of complexity n + l + 0{\ogN) such that 
• C{c\b)^C{c) + 0{logN); 
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• C{b\a,c) = 0{\ogN); 

• for every f such that C{f) < I — C{b\a,f) we have C{b\c,f) < m — n + C{b\a,f) + 
O(logA^). 

{The constant hidden in 0{-) depends on a but not on m, n, I.) 

Before proving this theorem, let us explain why it shows the importance of the condition 
in theoremlH The equation C{c\b) = C(c) + 0{logN) shows that the strings b and c are inde- 
pendent and C{b\c) = C{b) = n with C)(logA^)-precision. Since C{b\a,c) = 0{logN), we have 
C{a\c) > C{b\c) — C{b\a,c) = n (with the same O(logA^)-precision). Note also that C{b\a) = n 
(with O(logm) -precision). Therefore, if C{b\a,f) = 0{\ogN) for some string / of length not 
exceeding Z, then 

C{b\cJ) < mm{C{a\c),C{b\c)} + 0{\ogN) 

when m — n< n + 0{\ogN), i.e., when C{a) < C{b\c) + C{b\a). 

Proof. Let A be the set of all m-bit strings, and let B be the set of all n-bit strings. Let 
£— 1/ and 4> = 2' (/ + 1 ) . Our assumptions about n, m, / guarantee that A, B, £ and 4> satisfy 
the conditions of the lemma. Therefore there is a family with the properties described in the 
statement of the lemma. As we have said, we may assume without loss of generality that ^ 
is simple, and in this case the complexity of every element of ^ does not exceed log2#^ plus 
0(logA'^), i.e., does not exceed n -f / -|- C)( log A^^). 

Now let io(Z7) be the set {c G ^: C{c\b) < log2(#^) -2}; then mib) < #'^/4 for every b. 

Now the family ^ is constructed as follows. It contains 4> functions numbered by integers 
in 1. . .4> range. We enumerate all triples {a,b,f), where a G A, b E B and / is a /-bit string 
such that C(/) + C{b\a, f) < I. Some indices (numbers) have labels that are /-bit strings. When 
a new triple {a,b,f) appears, we first try to add {a,b) to one of the functions whose index 
already has label /. If this is not possible (all functions that have label / are already defined at 
a and have values not equal to b), we take a fresh index (that has no label), assign label / to it 
and let the corresponding function map ato b. A free index does exist since each / occupies 
at most 2'^''(-^)+^ indices (if some / needs more, then for some a all functions are 

defined and have different values, so we have enumerated already more than2'-'^(-^)+i different 
elements b such that C{b\a,f) < / — C(/); a contradiction), and all / in total require at most 
Y.c{f)<i 2'^'^(-^)+^ = Y!k^Q Jlc{f)=k 2'^^^^ = $ indices. After all the triples with these properties 
are enumerated, we extend our functions to total ones (arbitrarily). 

Consider the set of pairs {a,b) that are not covered by ^ (for given ^ and Sj). The 
cardinality of this set does not exceed £2"'+". On the other hand, ^ and Sj can be com- 
puted using O'-oracle, and after that the set of non-covered pairs can be enumerated, therefore 

{a,b) < m + n — a log2 m for every non-covered pair {a,b). 

Therefore for every a and b such that m + n — C^ {a,b) < alog2m there exists c E^ such 
that c{a) = b, c ^ S^{b), and for every / G ^ the equation c{x) = f{x) has at most 2™^"+^ 
solutions. 

Since c{a) = b, we have C{b\a, c) = 0{\ogN). 

Since c ^ S){b), we have C(c\b) > log2(#'^) - 2, i.e., C(c) = C{c\b) + 0{\ogN). 

Finally we have to estimate C{b\c,f) for strings / such that C(/) < / — C{b\a,f). Knowing 
/, we enumerate functions in ^ that have label /. One of them, say, /, goes through {a,b) 
(i.e., f{a) = b). To specify this functions, we need at most C{b\a, f) + 0{\ogN) additional bits. 
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Knowing / and c we may enumerate all x such that c{x) = f{x). (More precisely, we specify 
the index of / in not the / itself. However, to enumerate the solutions of the equation c{x) = 
f{x) it is enough to enumerate pairs {x,y) such that y = f{x) by replaying the construction of 
This set contains a and has cardinality at most 2'"^"+^, so we can specify a using m — n + 2 
additional bits. Altogether, C{b\cJ) < C{a\cJ) + 0{\ogN) < C{b\aJ)+m-n + 0{\ogN), 
as we claimed. 

Theorem [5] is proven. 

Open questions 

1. Is it possible to strengthen theorem [5] and have c of complexity at most n + 0{\ogN) 
instead of n + / + O(logA^)? (An.A. Muchnik in his talk claimed that this can be done by 
a more complicated combinatorial argument, which was not explained in the talk.) 

2. Theorem |5] shows that if a is only slightly more complex than b, then for some c short 
messages do not work. On the other hand, the alternative proof of theorem [T] works 
for empty c. What can be said about other c? What are the conditions that make short 
messages possible? 

3. What can be said about the possible complexities C{f\b), C{f\a,b), and C{f\a,b,c) if / 
is a message with the required properties? 
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KojiMoropoBCKan cjio>KHOCTb H KpnnTorpacJ^HH 

Ah. A. MyHHHK* 



AHHOTau,Ha 

C TOHKH speHHH KOJiMoropoBCKOH cjioJKHOCTH paccMaTpHBaioTca sa^aHH o no- 
CTpoeHHH coo6meHiiit, KOToptie co/i,epjKaT pasHoe KOjiHHecTBO HH4)opMaii,nn o aa- 
flaHHOM oGi^eKTe b saBHCHMOCTH OT Toro, KaKoit flonojiHHTejiBHOH HHcJ^opMai^Heft 
pacnojiaraeT nojiynaTejib. 

npe/];nojioJKHM, hto nojiynaTejib snaeT cjiobo a, h mbi xothm coo6mHTb nojiyna- 
Tejiio HH4)opMau;Hio o neKOTopoM cjioBe b, npn 3tom TaKHM oGpasoM, htoGbi name 
cooGmeHHe caMO no ce6e (6e3 a) ne nosBOJiajio BoccTanoBHTb b. OKasbiBaeTca, hto 

3TO B03M0JKH0 (eCJIH CJIOBa O H 6 He CJIHIUKOM npOCTbl) . 

/],ajiee paccMaTpnBaioTCH 6ojiee cjiojKHbie poflCTBennbie Bonpocbi: hto 5yfleT, ec- 

JIH "npOTHBHHK" 3HaeT HCKOTOpyiO IIH4)OpMaiI,Hro C? HaCKOJIbKO /I,JIHHHbIM /],OJIJKHO 

6biTb coo6meHHe? Mm yTOHHseM 3th Bonpocbi, yxasbiBaeM ycjioBHa, npn KOTopbix 
coo6meHHe MOJKeT HMeTb nojinnoMHajibHyio /],jiHHy, h noKasbiBaeM, hto ohh cyme- 

CTBeHHbl. 



1 HeHH(})opMaTHBHoe ycjiOBHoe onncaHHe 

B 3TOM pa3;];ejie mm fljia p^aHJihix cjiob a vl b (npn HexoTopMX orpaHHHeHHSx) nocxpoHM 
CJIOBO /, KOTopoe nosBOjiaex nojiyHHXb b h3 a, ho caMO no ce6e (6e3 a) ne co;];ep>KHT 
HH(|)opMan,HH oTHocHTejiBHo 6, a xaKJKe paccMOTpHM HeKOToptie o6o6iu;eHHa 3toh 3aflaHH. 

PaBHOMepnaa h nepaBHOMepHaa cjio:acHOCTb 

HanneM c neKoxoptix o6iri;HX 3aMenanHH, MOTHBnpyromnx nocxanoBKy 3a^anH c tohkh 
3peHH5i KOJiMoropoBCKOH cjioJKHOCTH ycjioBHoro onHcaHHJi. riycTb X — ncKOTopoe Mno- 
jKecTBO (flBOHHHbix) CJIOB, ay — CJIOBO. Tor^a mojkho onpe^ejinxb KS{X — )■ y) KaK 
MHHHManbHyio flJiHHy nporpaMMbi, Koxopaa ^aex y na jiio6om Bxojie a; h3 X. (KaK oGbih- 
ho, mbi (jDHKcnpycM ncKOTopbiH onTHMajiBHbiH cnoco6 3anHCH nporpaMM; mojkho xaKJKe 

BMCCTO MHHHMajIBHOfi fl^JlUHhl TOBOpHTB O MHHHMajIBHOH C JIOJKHOCTH . ) OhCBH^^HO, HTO 

KS{X ^y)^ maxKS{y\x) 



*Pe3yjii3TaTiji 3toh CTaTbH 6mjih flOjiojKeHbi Ah. A. MyHHHKOM (1958-2007) na KOJiMoropoBCKOM ce- 
MHHape Ka4)eflpiji MaTeMaTHnecKofi jiophkh h TeopHH ajiropHTMOB MFY (sace/iaHHH 11 MapTa h 8 anpe- 
jiH 2003 rofla), ho hc 6ijIjih Tor^a OHyGjiHKOBaHbi; hx 4)opMyjiHpoBKH cocTaBHjiH coflepjKaHHe flOKjia^a 
Ah. A. MyHHHKa h A. JI. CeMenoBa na ceMHnape b Dagstuhl (Seminar 03181, 27.04.2003-03.05.2003). 
TcKCT HOflroTOBHjiH A. HepHOB h A. UleHt b 2008-2009 ro^ax. 
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(ecjiH nporpaMMa p ro^HTca ^jia Bcex x G X, to OHa ro;];HTca jiioGoro h3 hhx), ho 
o6paTHoe Bepno ne Bcer^a h jieeaa nacTb mojkct Gbitb cymecxBeHHo Gojibine npaBofi. 
MojKHO CKasaxb, hto "paBHOMepHaa" cjiojkhoctb saj^aHU X y (jieBaa: nacxb) mojkct 
6t.iTb cymecTBeHHO Gojibine "HepaBHOMepHofl". 

HTo6bi yGe^HTbca b stom, BosbMeM b KanecTBe y necjKHMaeMoe cjiobo ^^jihhbi n, a 
B KanecTBe X BoatMeM MHoacecxBO Bcex cjiob x, ^Jia Koxopbix KS{y\x) < n/2. Tor^a 
npaBaa nacxb no nocxpoeHHio ne npeBocxo^HX n/2. HoKaJKeM, hxo jieBaa ne Menbine 
n — 0{\ogn). B caMOM ^ejie, nycxt p — HeKoxopaa nporpaMMa, Koxopaa ^aex y na jiio6om 
Bxo^e X, fljia Koxoporo KS{y\x) < n/2. Cpe^H xaxnx bxo^ob ecxb cjioBa cjioxcnocxn 
n/2 + 0(logn), n BMecxe c p hx ^ocxaxoHHo fljis nojiynenHJi y, nosxoMy KS{y\p) ^ n/2 + 
O(logn). Snannx, cymecxByex cjiobo e ^jinnbi O(logn), ^jih Koxoporo KS {y\{p,e)) < n/2. 
Ho npe^nojioJKennio p{{p, e)) = y m noxoMy cjioacnocxb p ne Mentme n — 0{\ogn). 

SaMenaHHe. MnoacecxBO X mojkho c^ejiaxt KonennBiM, orpannHnBinncb, CKaxceM, 
cjioBaMH j\jmmA ne 6ojiee 2n. 

Cjio:a<:HOCTi> sa^ann {a ^ b) ^ b 

riocxpoeHHbiH npHMep noKasbiBaex, nxo paBHOMepnas h nepaBHOMepnas cjiojkhocxh mo- 
ryx CHjiBHO oxjinnaxBCH. B cjie^yion^eM npnMepe sxo ne xaK, no ^oxasaxejibcxBO nx cob- 
na^enna xpe6yex ^onojinnxejibntix ycnjinii. 

Hycxb a,b — ^^Bonnnbie cjiOBa. Onpe^ejiHM (a — )■ b) kblk MHO»cecxBO Bcex nporpaMM, 
Koxopbie na Bxojie a ^aiox b. HsBecxno j2], nxo 



jiioGbix CJIOB a, b fljiHnt.1 ne 6ojiee A^. OKaatiBaexcH, hxo 3xo yxBep^Kflenne mojkho 
ycHjiHXB, saMcnHB paBnoMcpnyio cjioxcnocxt na nepaBnoMepnyio. 

TeopeMa 1. JJ^ah aw6ux caob a u b dnunu ne 6oAhme N Haudemcsi npodpauMa f , 
nepeeodsivnasi a e b, Oam, Komopou 



floKaaameAhcmeo. B o^ny cxopony (^) nepaBcncxBO oncBH^no ^jia jiio6oh nporpaMMbi 
/, nepeBo^ameii a b 6. B caMOM ^ejie, hmcs xaxyio nporpaMMy n jiioGoe h3 cjiob a h 6, 
MOJKno BoccxanoBHXb b. 

JXoKdJKeM, nxo flJiH neKoxopoH (|)ynKn;HH / Bepno n o6paxnoe nepaBencxBO. Hycxt. 
m — MaKCHMajitnaa h3 cjioxcnocxeii KS{b\f) ^jih Bcex c|)ynKn;HH, iiepeBOfl3iLi,HX a b 6. 
(Hpn 3XOM ML.I orpannnHBacMca KonennbiMH (|)ynKn;H5iMH, onpe^ejienntiMH na MHOJKe- 
cxBe Bcex cjiob ^jinnbi ne 6ojiee co snanennaMH b xom jkc MnoacecxBC, xaK nxo onn 
5iBj[iiioxc3 KonennbiMH o6x.eKxaMH n ycjiOBnaa cjioJKnocxb ecxecxBenno onpe^ejiaexca. 
SaMexHM xaKJKe, nxo c jiorapnc^DMnnecKofi xonnocxtio nex pa3nHn,t>i Meac^^y 4)ynKn;H5iMH 
H nx nporpaMMaMH.) HaM ii&f\o noKasaxb, nxo cjio>Knocxb xoxh 6bi o^noro ns cjiob a n 
b ne npeBocxo;i,HX m + 0(log A^). 

PaccMoxpHM MnojKecxBO S nap (a', b') cjiob ^jinnbi ne 6ojiBme A^, ^jia Koxoptix bbi- 
nojineno xaKoe cbohcxbo: KS{b'\f) ^ m Bar ecHKOu cpyHKii^uu f , onpedeACHHOu na ecex 
CAoeax dAUHU ne 6oAee N u npuHUMamut^eu SHaueHUH e moM otce MHOOfcecmee, Bah ko- 
mopou f{a') = b' . Ho nocxpoennio napa (a, b) bxo^hx b S. 



KS{{a ^b)^b) 



uAn{KS{a), KS{b)} + 0(log A^) 



KS{b\f) 



mm{KS{a), KS{b)} + 0{\ogN). 



2 



MHOJKecTBO S MOJKHO nepeHHCji3Tb, 3Haa h m. B xo^e SToro nepeHHCJieHHa Gy^eM 
GpaKOBaTb napbi, y KOTopbix a6ci];Hcca hjih op^HHaxa BCTpenaeTca ne b nepBbifi pas (cpe- 

He3a6paKOBaHHbix) ; ot S ocTaneTca neKOTopoe no^^MHoacecTBO S, KOTopoe aBjiHexcH 
rpa4)HKOM HCKOToporo BsaHMHo o^HosHaHHoro cooTBCTCTBHa. riapa (a, b) y>Ke ne oGasa- 
Ha npHHa^jiejKaxB S, ho b S ecTh jih6o napa c a6cn,Hccoli a, jih6o napa c opflHHaTofi b 
(HHane mbi 6b.i ne Bt.i6pocHjiH (a, 6)). 

riosTOMy ^ocTaxoHHo noKaaaxb, hto S co^epjKHx ne 6ojiee 0(2™) sjieMeHTOB (Tor^a 
nopa^KOBBiH HOMep yKasaHHOH napti b nepeHHCJieHHH MHOxcecTBa S co^epjKHT m 6htob 
H no3BOJi5ieT BoccTaHOBHTB jih6o a, jih6o b). 

B caMOM ^ejie, MHOJKecTBO S mojkho pacmnpHTB rpa(|)HKa neKOTopoH (|)yHKii;HH g. 
EcjiH (a', b') G S, TO g{a') = b' m noTOMy KS{b'\g) ^ m no riocTpoeHHio {S HBjiHeTCH no^- 
MHO»cecTBOM S) . SnaHHT, B S HMeexca ne 6ojiee 0(2™) pasjiHHHbix fe', a no nocxpoeHHio 

HX CTOJIBKO >Ke, CKOJIBKO Iiap B 5. □ 

KpnnTorpacJjHHecKaH HHTepnpeTai],Ha 

yTBepjK^eHHe npe^bi^ymero nynKTa HMeeT cjie^yiomyio HHTepnpeTaii;Hio. Mbi xothm ne- 
pe^axB HH4)opMan;Hio o cjiobc b neKoxopoMy nejioBexy, yace 3Haioiri;eMy cjiobo a, nocjiaB 
eMy HeKoxopoe cooGmeHHe /. (Bnecxe c a sxo coo6iii;eHHe hosbojimx jierKO BoccxanoBHXB 
CJIOBO b.) HpH 3XOM MBi xoxHM, Hxo6t.i fljiH HenocB5iin;eHHt.ix, xo ecxb jiio^eH, He anaio- 
in;Hx cjioBa a, cooGmeHHe / necjio MHHHMajitHo BosMoxcnyio HH4)opMaij,Hio o 6, xo ecxt 
Hxo6bi cjiojKHocxb KS{b\f) 6t.ijia MaKCHMajibHo bosmojkhoh. KaK mbi yace BH^ejin, sxa 
cjiojKHOcxb He MOJKex 6t>ixb 6ojibme KS (b) h ne Moacex 6t>ixb Gojibine KS (a) (nocKOjiBKy 
BMecxe c a coo6iii;eHHe / nosBOJiaex jierKO BoccxanoBHXb b). TeopeMa [T] noKasbmaex, hxo 
3xa rpaHHn;a {min{KS (a) , KS [b)}) ^eHcxBHxejit-Ho ^ocxHraexca. 

MoJKHO paccMoxpexb pejiaxHBHSOBaHHbifi Bapnanx sxofl sa^^ann, Kor^a HenocBameH- 
HbiH 3Haex HCKoxopoe xpexte cjiobo c. Hame paccy^K^eHHe (cooxBexcxBenno pejiaxHBH- 
30BaHHoe) nosBOjiHex Hafixn 4)yHKii;mo /, nepeBo^amyio a b b, fl^jis Koxopofi 

KS{b\f,c) =mm{KS{a\c),KS{b\c)}; 

3Xa 4)yHKn;iI5I CO^epjKIIX MHHHMajIBHO BOSMOJKHyiO HH(|)OpMan;HK) O 6 (c XOHKH SpCHHH 

3Haioiri;iix c). OopMajiBHO roBopa, Bcpno cjie^yiomee yxBcpac^eHne (h ero ^OKasaxejibcxBO 
noBxopaex ^OKaaaxejibcxBO xeopeMti [1]) : 

TeopeMa 2. Uycmb a,b,c — CAoea Bauhu ne 6oAee N. Tozda naudemcji CAoeo f , Oasi 
Komopozo: 

(1) KS{b\aJ) = Oi\ogN); 

(2) KS{b\c,f) = Ynm{KS{a\c),KS(b\c)} + 0{\ogN). 

YcjioBue (1) roBopHx, hxo coo6in;eHiie / ^jih nocBHmeHHbix (snaromiix cjiobo a) co- 
^epjKHx BCK) HeoGxo^HMyio iiH(|)opMaii,Hio o 6, a ycjioBiie (2) roBopnx, hxo ^jih neno- 

CB5IIU;eHHt.IX (snaiOmUX XOJIBKO c) oho CO^epJKIIX MHHHMajItHO BOSMOJKHyiO IIH(|)OpMaii;HIO 

o b. 

SaMenaHHe. C nepBoro Bsrjia^a mojkcx noxasaxbca, hxo ^^OKasaxejibcxBa xeo- 
peMbi [1] ^ocxaxoHHO b KanecxBC / Bsaxt. KpaxHailmee onncaHHe b npH hsbccxhom a — 
^ecKaxb, xor^a b hcm hc Gy^ex "jinmHefi HH(|)opMaii;HH". Ho sxo ne xax: ecjiH a m b — 
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HesaBHCHMbie cjiyHafiHbie cjioBa ^jihhm n, to aBjiaexca tekhm KpaxHaflinHM onncaHHeM, 
HO He ro;];HTca b KanecxBe / (nocKOJiBKy KS{b) h KS{a) 6jih3kh k n, a KS{b\b) 6jih3ko k 
Hyjiio) . B 3TOM npHMepe mojkho bshtb b KanecTBe / noGnxoByio cyMMy a (Bb cjiob a a b 
no MopyjiK) 2 — ona nosBOJiaeT 3Haioiri;eMy a BoccxaHOBHTb b, ho KS{b\f) ^ n. 

BocnojibsOBaBniHCb xeopeMoli o npocxoM ycjioBHOM onHcaHHH jT], mojkho anajiorHH- 
HL.IM cnoco6oM flOKasaxb yxBepjK^eHHe xeopeMbi [1] CorjiacHo xeopeivie o npocxoM ycjioB- 

HOM OHHCaHHH, CymeCXByeX CJIOBO b', KOXOpOe HBJIHeXCH MHHHMajIBHblM OHHCaHHeM b 

npH HSBecxHOM a, npocxtiM oxHOCHxejitno b. 3xo osnanaex, hxo KS{b'\b) = 0{\ogN), 
KS{b\a, b') = 0{logN) h ^jiHHa b' paBHa KS{b\a) + 0(log A^). PaccMoxpHM xaKJKe cjiobo 
a', Koxopoe aBjiaexca MHHHMajibHbiM onHcaHHCM a npn HSBecxHOM b, npocxbiM oxhoch- 
xejiBHO a, H ypaBHHeM ero no ^jinne c b' (oxpesaB jiHrnnne Ghxbi hjih ^oGaBHB nyjin, b 
saBHCHMOcxn ox xoro, y KaKoro ns cjiob a h 6 6ojibme cjiojkhocxb) , nojiynnxcH a". Tenepb 

MOJKHO B33Xb B KaneCXBC / CJIOBO a" © b'. 

Snaa / n a, mbi mojkcm nojiynnxb a' n saxcM a" 6e3 ^onojiHHxejibnoH HH4)opMan,HH 
(xonnee, c jiorapH(|)MHnecKOH ;];onojiHHxejit.HOH HH4)opMan;HeH) , nocne lero mojkho no- 
jiynnxb b' n saxcM b. Hccjiojkho npoBepHXb xaKJKC, nxo KS{b\f) = mm{KS (a) , KS{b)} 
c jiorapH(|)MHHecKOH xonnocxBio. 

B caMOM ^ejie, c jrorapHcjDMHnecKoii xohhocxbio 

KSib\f) = KSib, f\f) = KSib, b', f\f) = KSib, a"\f) > 

^ KS{b,a") - KS{f) ^ KS{b,a") - \f\ = KS{b,a") - KS{b\a) 

CjiOBa a' Jib neaaBHCHMbi (hmciox jiorapncjDMHnecKyio BsanMnyio HH(|)opMan;Hio) , nosxoMy 
CJIOBO a" (Koxopoe nojiynaexca ns a' c jiorapncjDMnnecKOH cjiojkhocxbio) xaxace nesaBHcn- 
Mo c b. HosxoMy hhjkhioio on,eHKy mojkho npoflojiacnxb KaK KS{b) — KS{b\a) + KS{a"), 
HTo paBHo mm{KS {a) , KS{b)}. (Konen; ajiBxepnaxHBHoro ^oxasaxejibcxBa xeopcMbi [T]) . 

HpeHMymecxBO axoro paccyjK^eHHS b xom, nxo cjiobo / nojiynaexca nojinnoMHajibHOH 
(ox N) ^jiHHL.1 H ^ajKc MHHHMajiBHo BosMOJKHoii ^jiHHL.1 KS{b\a). (B flpyroM ^oKaaaxejib- 
cxBe CJIOBO / 6t.ijio (|)yHKn;Heii c SKcnoneni^najiBno GojiBinoii o6jiacxBio onpe^ejiennH.) 
^pyrHMH cjioBaMH, mbi ^OKasajiH xaKoe yxBepjK^enne: 

TeopeMa 3. /(/i^ ak)6ux deyx caob a ub Bauhu ne 6oAee N naudemcsi CAoeo f Oauhu 
KS{b\a), Bah Komoposo 

KSib\f,a) = Oi\ogN) 

u 

KS{b\f) = mm{KS{a), KSib)} + O(logiV). 

C flpyroR cxopoHbi, ne^^ocxaxoK 3xoro paccyjK^enna b xom, nxo ono ne o6o6iri;aexca 
(no KpaiiHeii Mepe nenocpeflcxBcnno) na cjiynaii ^onojinnxejibnoii HH(|)opMan;HH c (xo 
ecxB ne nosBOJiaex ^OKaaaxb xeopeiviy [2]) . Hycxt oiihxb a m b — cjiynannbie neaaBHCHMbie 
cjioBa o^HHaKOBOH fljiHHL.1 2n, a ai, a2 [bi, 62] — nepBaa n Bxopaa nojioBHHti cjioBa a 
[cooxBexcxBeHHO b]. Hycxb cjiobo c cocxohx h3 ^Byx hojiobhh Oi © 02 © 61 h 02 © fei © ^2- 
Tow KS{a\c) = KS{a, c\c) = KS{a, b\c) = 2n, KS{b\c) = 2n, no KS{b\c, a®b) = 0. 

B cueflyiomeM pas^^ejie mbi jxaj^jiM KOMGnnaxopnoe ^oxaaaxejibcxBo cymecxBOBanna 
KopoxKoro cooGmenHH /, Koxopoe coflepjKHx bcio HH(|)opMau,Hio o b fljia 3HaK)iLi,Hx a, ho 

He flJIH 3HaiOILI,HX XOJIBKO C. 
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2 KoMSHHaTopHoe nocxpoeHHe onncaHHa 

MHHHMajIbHOH CJIO:)KHOCTH 



CeHHac Mbi ^OKaJKeM, hto ecjiH cjiobo a co^epjKHT ^ocTaTOHHO mhofo HH4)opMaLi;HH (toh- 
Hee roBopa, ecjiH KS{a\c) ^ KS{h\c) + KS{h\a) + O(logA^)), to cymecxByex coo6iii;e- 
HHe /, KOTopoe oGjia^aex yKasannbiMH b xeopeivie [2] cBoficTBaMH h HMeex cjiojkhoctb 
KS{h\a) + O(logA^). J\jiii sxoro mbi HcriojitsyeM cjie^yiomyio KOMGHHaTopnyio jieMMy. 
(Hepes B'^' mbi oGosHanaeM MHOJKecxBo Bcex /c-Ghtobbix cjiob.) 

KoMSHHaTopnaa JieMMa 

JleMMa. /(yi^ aw6ux HamypaAbHux m u n ^ m cymecmeyem ceMeucmeo T cf)yHKii,uu 
euda B" — t- B™, cocmonmee U3 2'"poly(?7,) (fjyHKV^uu u oSAadatomee maKUM ceoucmeoM: 
dAH AH)6oeo CAoea b G B™ u Oam, a'io6oso nodMHOcucecmea T' , code'pMcavutfizo ne Menee 
noAoeuHU ecex c^yHK-u,uu us T , MHOMcecmeo moHCK co emopou KoopduHamou b, ne no- 
Kpumux spacpuKaMu (j^yHKii^uu us T' , codepMcum ne 6oAee 0(2™') mouen. 

OopMajiBHo cBoiicTBo ceMelicTBa J-", o KoxopoM Hflex pent b jieMMe (pnc. [1]), mojkho 
sanHcaxB xax: 

V6VJ^' C ^[l^'l ^ ^I-FI ^ \{a G B'^ I /(a) ^ b p^iiii Bcex / G J^'}\ = 0(2™)] 

(SaMexHM xaKJKe, hxo ycjioBne n ^ m HSJiHinne: npn n < m yxBepac^eHHe jieMMbi bbi- 
nojiHCHo oHeBHflHbiM o6pa30M, nocKojiBKy KojiHHecxBo Bcex a ecTh 0(2™).) 

H^ea npHMeneHMH jieMMti: (|)yHKii,HH, ne Hecymne HH(|)opMaij;HH o b, cocxaBjiHiox b 
JI1060M npocxoM ceMeiicxBe Gojibiuhhcxbo, h noxoMy cpe^H hhx Haii^excH (|)yHKn;H5i, ne- 
peBo^amaH a b b, ecjiH xojibko a ne ripHHa^JiexcHX MajiOMy MHOJKecxBy HCKjiioHeHHii (hxo 
6yflex npoxHBopeiHXb npeflnojiojKeHHio 06 a, xax KaK 3xh HCKjnoHeHHH hmciox Majiyio 
cjiojkhocxb) . 




b 



W 



Phc. 1: HacxB (|)yHKii,HH (flo 50%) h3 J-" BbiGpomeHbi; xeM ne Menee rpa(|)HKH ocxaBinnxca 
noKpbiBarox jiroGyio ropHSOHxajib, ne cnnxaa 0(2™) xoneK. 

/JoKasameAhcmeo. Hcnojibsya BepoHXHOcxHbifi Mexo^, BosbMeM cjiynafiHoe ceMeficxBO h3 
2* cjiyHafiHbix (|)yHKii,HH ipi, . . . , ip2t. (Bee 3xh 4)yHKn;HH nesaBHCHMbi h paBHOMepno pac- 
npe^ejieHbi b MHOJKecxBe Bcex (|)yHKii;HH B" — )■ B™; xoHHoe sHaneHHe napanexpa t mbi 
Bt>i6epeM nosace.) On;eHHM BepoaxHocxb xoro, hto 3xox Ha6op ne o6jia;];aex xpeGyeMbiM 
CBoficxBOM. 3xo osHanaex, hto nafi^yxcji 



5 



• 6 G B"*; 

• MHoacecTBO 5 C B" H3 s ■ 2*" sjieMCHTOB (KOHCxaHTy s Mhi Bt.i6epeM no3>Ke); 

• MHOJKecTBO /c{l,2,...,2*}, co^epjKamee nojioBHHy Bcex HH^eKCOB, 
fljia KOTOptlX 

ipi{a) 7^ b fl^Jis jiioGoro a E S n fl^Jis jiioGoro i E I (*) 

On;eHHM BepoHTHOcxB axoro co6bith5I. KojinnecTBO pasjiHHHbix b ecTh 2^", KOjiHHecTBO 
pasjiHHHbix I He ripeBocxo^HT 2^*, a KOJiHHecxBO pasjiHHHBix 5* ne npeBocxo/i;HT (2")*^'". 
HpH (|)HKCHpoBaHHt>ix b, S VL I BepoaTHocTb BbinojiHeHHa ycjioBHa (*) ecTt 




(xajK^^aa h3 2* ^ 4)yHKn;HH c HOMepoM b / b KayKpp^ TOHxe a e 5" ne nona;];aeT b fe c 
BepoaTHOCTBK) (1 — 1/2"^)). Bcero ^jih BepoaxHOCTH nojiynaeM BepxHioio oiJ,eHKy 

2™ ■ 2^* . 2"^2'" . ( 1 _ ^ ] 
V 2™ J 

H Ha;];o noKasaxb, hto npn npaBHjiBHO BbiGpaHHbix SHaneHHax napaneTpoB sto Bbipaace- 
HHe MeHBine e^HHHij;bi. YHHTbiBaa, hto (1 — 1/2'")^™ ^ 1/e (c ropas^^o 6ojiBmeii tohho- 

CTblO, HCM HyjKHO HaM), MOJKHO nepeHHCaTB 3TO KaK 

OcHOBHyio pojib HrpaioT Hjienbi, KOTopoe co;],ep>KaT 2* h 2"^ b noKasaxejie cxeneHH (no- 
CKOJiBKy 2*, 2"^ ^ m,n,s). HaM nyacHo, HTo6t.i Majibifi nocjie^HHH coMHOJKHxejiB nepe- 
BecHji ^Ba ocTajiBHbix. Pa3o6beM nocjie;i,HHH coMHOJKHxejiL. na jJ,Be nacxH h 

CpaBHHM 3TH HaCTH C nepBBIM H BTOpBIM COMHOJKHTe JICM . HaM HyjKHO, HTo6t>I 

2™+2'-(l/e)^2V4<i 

HepBoe HepaBeHCTBo Gy^ex BBinojiHeno, ecjin bshtb KOHcxaHTy s ;i;ocTaTOHHO Gojibinofi. 
BbinojiHeHHH BToporo HepaBencTBa (b KOTopoM cxeneHH mojkho coKpaxHTb na s) jierKO 
flo6HTbC3, nojiojKHB 2* = 2'^poly(n). □ 

OcHOBHoit pesyjibTaT 

Tenepb mm MoaceM ^axb xoHHyio (jDopMyjinpoBKy h ^OKasaxejibcxBO ocnoBHoro pesyjib- 
xaxa: 

TeopeMa 4. HaudemcH maKan KOHcmaHma C , umo Oam, aw6ux caob a, b, c Oauhu ne 
6oAee N, dAsi Komopux 

KS{a\c) ^ KS{b\c) + KS{b\a) + C log N, 

cymecmeyem CAoeo f Oauhu ne 6oAee KS{b\a) + ClogA^, dAsi Komoposo KS{b\a,f) ^ 
ChgN u KS{b\c,f) ^ KS {b\c)-C log N. 



6 



YcjioBHe xeopeMbi osHanaex, hto HMeromeeca b pacnopHJKeHHH nojiynaxejia cjiobo a 
co^epjKHT ^ocTaxoHHo HHcjDopMaitHH, oTcyTCTByiomeH y "npoTHBHHKa" (aHaiomero cjiobo 
c); saKjiioHeHHe roBopHX, hto cjiobo / nosBOjiaex BoccxanoBHTb 6 no a h hmcct {cpefl^R 
xaKHX cjiob) MHHHMajiBHO BOSMOJKHyio ^^JiHHy, a TaKJKC He ynpomaex BoccxaHOBjieHne 
b no c. (Bo Bcex BbipaJKennax O(logiV) ncnojibsoBana oflfia h xa jkc Koncxanxa C, no 
nocKOjiBKy c pocxoM C yxBepjK^eHHe cxanoBHXca cjia6ee, axo ne iipHHii,HnHajiBno.) 

floKaaameAhcmeo. HpHMennM xeopcMy 06 ycjioBnoM KO^HpoBannn [T| n nafi^eM cjiobo 
h' ^jiHHt.1 KS{h\a), fljia Koxoporo cjioacnocxn KS{h\b\a) h KS{h'\h) paBHbi O(logiV). 
HpHMennM KOMGnnaxopHyio jieMMy n nocxponM ccMeilcxBO oxoGpaacennn B" — )■ c 
yKaaannbiMn b neii cBoiicxBaMH, b35ib m paBntiM fljinne 6', xo ecxb KS{h\a), a n paBntiM 
fljinne a. Bes orpannnenna o6ii];nocxn mojkho cnnxaxb, nxo ccMencxBO J-" aBjiaexca npo- 
cxBiM, xo ecxb HMeiomHM cjiojKnocxB 0(log A^), nocKojiBKy npn ^annbix mun ceMencxBo 
4)yHKn;HH c nyacHbiMH cBoiicxBaMn mojkho ncxaxb nepeGopoM. 

BojiBinnncxBO 4)ynKn,HH b sxom ccMencxBe (xaK n b jiio6om ^pyroM npocxoM ceMett- 
cxBc) ne CHjibno ynpomaiox 3a;];anne b npn nsBccxnoM c (hmciox Majioe ananenne pasnocxn 
KS{b\c) — KS{b\c, /)). B caMOM ^ejie, c xonnocxbio O(logiV) sxo mojkho nepenncaxb xax 
KS{f\c) — KS{f\b,c) (no xeopcMC o cjioacnocxn napt>i n ycjiOBnoii cjioacnocxn) , cpe^nee 
snanenne o6onx njienoB ecxt. jiorapn(|)M nncjia sjicMcnxoB ceMencxBa (b ;];annoM cjiynae 
m + 0{logN)), nosxoMy cpe;i,nee snanenne pasnocxn ecxt O(logA^) n ocxaexca Bocnojit.- 
aoBaxBCH nepaBencxBOM HeGtimeBa. 

OcxaBHB B ccMeiicxBe J-"' xojlbko 4)ynKn;nn na sxoro GojitmnncxBa, mbi (no jicmmc) 
noKpocM nx rpacj^HKaMn napt.1 Bn^a (a', b') npn Bcex a' ^jinnti n, xpoMC 0(2"^) "njioxnx" 
a', n naM na^o yGe^nxBca, nxo a ne nonajio b nncjio njioxnx. ^Jia sxoro flocxaxonno 
iioKasaxB, nxo 

KS{a'\c) < KS{b\c) + KS{b\a) + 0{\ogN) 

fljiH Bcex njioxnx a'. B caMOM ^ejie, snaa 6 n c, a xaxjKe KS{b\c) (nocjie^nee nncjio co^ep- 
jKnx 0(log A^) 6nxoB, n c jiorapn(|)MnnecKOH xonnocxbio hm mojkho npeneGpenb), mojkho 
nepenncjiHXB Bce (|)ynKn;HH /, ne nonaBinne b ccMencxBO J-"' (ynpomaiomne aa^anne b npn 
nsBecxnoM c), a noxoMy n xonxn, ne noKpt.ixt.ie rpacJinxaMn (|)ynKn,nH na ccMcncxBa J-"'. 
(HanoMnnM, nxo b' mojkho xaKJKe BoccxanoBHXb no 6 c jiorapn(|)MnnecKOH cjioxcnocxtio.) 
3xhx xoncK no jicmmc ne Gojiee 0(2™), nosxoMy nx cjiojKnocxb npn nsBecxnbix b,c ne 
6ojiee m + O (log A^) . HojiynaeM 

KS{a'\b,c) ^ KS{b\a) +0{logN) 

fl^jis Bcex njioxnx a', n noxoMy 

KS{a'\c) ^ KS{a'\b,c) + KS{b\c) + 0{logN) ^ KS{b\a) + KS{b\c) + O {log N), 

nxo n xpe6oBajioct.. □ 

3 OTpHii,aTejibHbiH pesyjibxaT h Bonpocbi 

YcjioBne na cjiojKnocxn b xeopcMC 2] mojkcx noKasaxtca ncKyccxBennbiM. CxaJKeM, ecjin 
cjioBa a, b, c nonapno nesaBHCHMbi, mbi xpeGyeM, nxo6t>i cjiojKnocxb cjioBa a 6t>ijia b^boc 
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6ojibme cjioJKHOCTH cjioBa b, h sto Bbirjia^^HT cxpaHHO (noneMy arenx ^ojiJKeH HSHanajibHO 
HMexb BflBoe Gojibine HHcjDopMai^HH, hcm mbi xothm nepe^aTB? MOJKex 6biTb, ycjioBHa 
KS{a) > KS{h) Gbijio 6i>i ^ocTaxoHHo?). 

B 3TOM pas^ejie mbi noKaJKeM, hto HepaBencTBO b ycjiOBHH xeopeMbi H] Ha caMOM 
^ejie cymecTBeHHo: ecjiH sToro He TpeGoBaxb, to MOJKeT oKaaaTbCH, hto Bce cjioBa /, ^jia 
KOToptix BBiHojiHCHo yxBepjKfleHHe TeopeMbi 121 HMeioT oneHB 6ojiBmyio ^jinny. ToHHoe 
yTBepjK^eHHe (cm. HHJKe xeopeMy [5|) h ero ^oKasaTejitcTBo aobojibho ^jiHHHbie, h mbi 
HaHHeM c Gojiee npocxoro paccyxc^eHHa, Koxopoe, npaB^a, ^aex npHMep c oneHb 6ojibmoH 

CJIOJKHOCTBK) CJIOBa C. SaXCM MBI nOKaJKCM, KaK MOJKHO yMeHBUIHTB CJIOJKHOCTB CJIOBa C. 

By^eM cxpoHTB xpn cjiOBa a, 6, c, o6jiaflaioiu;He xaKHMH cBoiicTBaMH: jiio6a5i ne oneHb 
fljiHHHas (cKajKCM, nojiHHOMHajibHaH OT cjiojKHocTeii cjioB HjiH ^a>Ke cy63KcnoHeHii,Hajib- 
Haa) nporpaMMa /, nojiynaiomaH 6 hs a, snaHHTejibHO ynpomaex nojiyHenne fe h3 c. B 
3TOM npHMepe cjioBa a h 6y;];yT hmctb cjiojkhoctb npHMepno l,3n h cooTBexcTBeHHO, 
a Hx BsaHMHaa HHcjDopMaitHa 6y^eT GjinsKa k nyjiio. (Ko34)4)Hij;HeHT 1,3 BbiGpan flocTa- 
TOHHO npoHSBOjiBHo; BaJKHO, HTO OH Gojibuie 1 H MeHbine 2.) Cjiojkhoctb h npn HSBecxHOM 
c 6y^eT paBHa npHMepno n, xax hto ;];o6aBjieHHe c b KanecxBe ycjioBHa ne yMeHbinaex 
cjiojKHocTB h. A BOX flo6aBjieHHe (k ycjioBHio c) jik)6oh nporpaMMbi /, nojiynaiomeH h 
H3 a, cymecTBCHHo yMeHBinaex ycjioBHyio cjiojkhoctb h: bmbcto KS{h\c) ~ n nojiynaeTCH 
KS{b\f,c) ^ 0,3n. 

OcHOBHaH H^ea KOHCxpyKi^HH xaKOBa: cjiobo c caMO 6y^eT (|)yHKn;Heii, nepeBOflHmefl 
a B 6 (ho HpH 3TOM 6e3 a cjiobo c hc co^epjKHT HHKaKOH HH(|)opMaH;HH o b). riycTB HaM 
flana HCKOxopaa nporpaMMa /, Koxopaa xaKace HepeBOflHX a b b. KaK ona noMoraex sa- 
^axb b npn hsbccxhom c? Mbi snacM, hxo r c, r f nepeBo^ax a b b, no3XOMy a SBjiaexcH 
o^HHM H3 pemeHHH ypaBHCHHa c{x) = f{x). 3xh pemcHHa mojkho nepenncjiaxb, snaa c h 
/ (nporpaMMa / mojkcx 6t>ixb onpe^ejiena ne Bcmpy, no 3x0 ne Memaex). Ecjih pemennn 
Majio, xo Moacno 3a;];axB a (a xcm caMtiM n b), yxasaB ero nopa^KOBbin noMep b nepe- 
nncjiennn xaKHX pemennn. 3xoro ^ocxaxonno npn nsBecxntix c n /, n MOJKex xpeGoBaxb 
Menbme 6nxoB, ncM KS{b) (xoxopoe paBno KS{b\c); KaK mm roBopnjin, caMO no ce6e c 
ne co^epjKnx nn4)opMan;nn o b). 

rioKaJKCM, nxo c 6ojibmoH Beposxnocxbro xaKoii npnMep nojiynnxcH, ecjin cjiynaiino 
BbiGpaxb napy cjiob {a,b) cooxBexcxByK)iu;nx ^jinn (l,3n n n), a b KanecxBe c Bbi6paxb 
cjiynaiinyK) (|)ynKn;nK) (c apryMenxaMH n snanennaMH cooxBexcxByK)iu;nx ^jinn), rpa(|)nK 
KoxopoH npoxo^nx nepes (a, b). (To jkc caMoe pacnpe;];ejienne Bepoaxnocxen, nojiynnxca, 
ecjin cnanajia Bbi6paxb cjiynannyro 4)ynKU,nK), a noxoM na ee rpa4)nKe Bbi6paxb cjiynan- 
nyio xonKy.) 

CjioBa a n 6 ^ypyT nMexb nyacnbie cjioJKnocxn n Majiyro BsanMnyio nn4)opMan;Hio 
c 6ojibmoH BeposxnocxbK). Hyxb cjioacnee nonaxb, nxo cjioacnocxb b npn hsbccxhom c 
6yflex 6jin3Ka k n. B caMOM ^ejie, xnnnnnaa (|)ynKn,n5i c c apryMenxaMn ^jinnbi l,3n n 
snanennHMn ^jinnbi n npnnnMaex 6ojibmnncxBO CBonx ananennn npnMepno o^nnaKOBoe 
nncjio pas (okojio 2*^'^"), n noxoMy pacnpe^ejienne Bepoaxnocxeii ^jih Bxopon Koop^nnaxbi 
cjiynaiinoH xonKn ee rpa(|)nKa 6jin3KO k paBHOMepnoMy, n Gojibmaa nacxb ananennn Gy^ex 
cjiynaiina ^aJKC npn nsBecxnoii (|)ynKn;nn c. 

Hycxb xenepb ^ana ncKoxopaa nporpaMMa /, nepeBo^^amaa a b b, npnneM ona HMeex 
ne onenb Gojibmyro fl^Jinny (cyin;ecxBenno Menbmyro, ncM xo, nxo ^aex xeopeMa|2]). CKOjib- 
Ko pemennn 6y^ex nMexb ypabnenne f{x) = c(x)? B xnnnnnon cnxyan,nn (flJia ^annon 
/ n cjiynannoH c) xaKHx pemennii Gy^ex okojio 2°'^" (b Kaac^on xonKe coBna^enne c 
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BeposTHOCTbK) 2~", a TOHeK 2^'^"); s^ecb ml.i npe^nojiaraeM, hto / Bcio^y onpe^ejiena, 
HO ecjiH Hex, pemeHHH Gy^ex xojibKo Menbine. CymecxBeHHo 6ojit.mee hhcjio coBna^e- 
HHii jiJis ;];aHHOH 4)yHKn;HH / h cjiynafiHO BL.i6paHHOH c oneHb MajioBepoaxHO, ppYmwa 
cjioBaMH, map cooxBexcxByiomero pa;i,Hyca b MexpHKe XeMMHHra HMeex onenh Majiyio Be- 
poHXHocxb. riocKOJiBKy xaKHx mapoB He oneHb mhofo, xo h hx o6x.eflHHeHHe Gy^ex hmcxb 
Majiyio BeposxHocxB, h c GojitmoH BepoaxHocxtio cjiynaHHas 4)yHKii;H5i c ne nonaflex hh 
B o^HH H3 3XHX mapoB. 3xo sHaHHx, Hxo fljiH xaKOH (|)yHKii;HH ypaBHCHHe c{x) = f{x) 
fljiH jiio6oii He oneHb ^jihhhoh nporpaMMBi / 6y^ex HMexb jinniB neMHoro Gojiee 2°'^"' 
pemeHHH, h noxoMy cjiojkhocxh KS{a\f,c) h KS{b\f,c) 6y^yx jiHmt nyxt 6ojibme 0,3?7,, 
KaK Mbi H o6em;ajiH. 

Mbi He HpoBOflHM aKKypaxHo cooxBexcxByromne on;eHKH, xax xax xoxhm ^oKasaxb 
6ojiee CHjiBHoe (h cjioacHoe) yxBepac^enne. A HMenno, mbi xoxhm nafixH cjiobo c cpaBHH- 
xejiBHO He6ojiBmoH cjiojkhocxh (a ne 3KCHOHeHH;HajibHOH cjiojkhocxh, KaK b HSjioaceHHofi 
KOHCxpyKn;HH) ; cjiojkhocxb cjioBa c 6y^ex npHMepno na KS{b) Gojibme, neM cjiojkhocxb 
HporpaMM /, fl^jis Koxopbix OHO Gy^ex KOHxpnpHMepoM. (3xo ne y^HBHxejibHo: neM Gojib- 
me HporpaMM / mbi ^oji^khbi "onpoBeprnyxb", xeM Gojihuias CBo6o^a b BbiGope c xpeGy- 
excH.) 

H^ea KOHcxpyKn;HH — Bt.i6op xohkh na rpacjDHKe cjiynaHHOH (|)yHKH;HH c — coxpana- 
excH, xojiBKo xenept c 6y^ex BB.i6HpaxBCJi ne cpe^n Bcex 4)yHKH;HH (c apryMenxaMH h 
3HaHeHH5iMH HyjKHOH fljiHHBi), a cpe^H (|)yHKH;HH HeKoxoporo ceMeiicxBa C. Mm ccjaop- 
MyjiHpyeM KOMGnHaxopHbie CBOHCXBa, KoxoptiM ^ojijkho y^oBjiexBopaxt 3xo ceMeiicxBO, 
^OKaJKeM (BepoaxHocxHo), hxo xaKoe ceMettcxBO cym;ecxByex, saKjiioHHM oxcio;];a, hxo cy- 
mecxByex npocxoe ceMeflcxBO c sxhmh CBoficxBaMH (nepeGop), a saxeM ^OKaaceM, hxo 
GojibmHHCXBa xoneK a, b Hafi^^exca (|)yHKH;Ha c h3 ceMeflcxBa, Koxopaa y;];oBjiexBO- 
pHex HyjKHbiM xpe6oBaHH3M. (TaKHM o6pa30M, Mbi ^oKajKeM He npocxo cym;ecxBOBaHHe 
xpoHKH {a,b,c), a 6ojiee CHjibHbiii 4)aKx: jiJis GojibmnncxBa nap {a,b) cym;ecxByex c.) 
OrpaHHHHBaH pasMep ceMelicxBa, mm xeM caMbiM orpaHHHHBaeM cjio^khocxb cjioBa c. 

HyjKHoe HaM KOMGnnaxopnoe yxBepac^enne mm c(|)opMyjiHpyeM b BH^e jieMMbi. Hycxb 
^aHM MHOJKecxBa A R B. By^eM roBopnxb, hxo neKoxopoe ceMeiicxBO J-" 4)yHKH;HH BH^a 
A ^ B 6paKyem 4)yHKH;Hio c: A ^ B, ecjiH npn KaKOM-HH6y^b j ^ T pasMep MHOJKecxBa 
{a: c(a) = /(a)} 6ojibme 4|yl|/|i?| (hhcjio Kopnefi 6ojiee neM b 4 pasa npeBocxo^HX 
"oJKH^aeMoe") . Hycxb — Ha6op ceMeiicxB (|)yHKn;HH h3 A b S, HapaMexpHSOBaHHbiH 
sjieMenxaMH b (xo ecxb npn jiio6om b & B HBjiaexca ceMeflcxBOM 4)yHKH;HH BRfl^a 

A ^ B). CKaJKeM, hxo 4)yHKH;H5i c nonpueaem napy {a,b) ^ A x B npn jxannhix J-" h i^, 
ecjiH c(a) = b, npn sxom c ne saGpaKOBano ceMeflcxBOM u c ^ Sj{b) . 

JleMMa. Uycm'b A u B — nenycmue MHOCucecmea deouuHux CAoe, npuucM B codepcHcum 
He Menee deyx aAeMenmoe u \A\ ^ 16|i?|. Uycmb maKCHce danu hucaq e ^ 4|i?|/|y4| u 
$ ^ 21^1/^1^1. Todda naudemcn manoe ceMeucmeo C (f)yHKV,uu euda A ^ B pasMepa 
[Mom,Hocmu) 



nmo djiH AK)6o20 ceMeucmea T pasjuepa ne 6oAee $ u dAn Am6ozo Ha6opa S) ceMeucme, 
Kaofcdoe U3 Komopux UMeem pasMep ne 6oAee Hemeepmu \C\ {mo ecmh \S){b)\ ^ |C|/4 
npu ecex b ^ B) ne 6oAee e-doAU ecex nap U3 A x B ne noKpumo hu oBhum c & C npu 
dauHux u Sj. 
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OopMajibHO yTBepjK^eHHe jieMMbi Bt.irjia;],HT Tax (mbi onycKaeM ycjioBHa na pasMepbi 

c,TiiS){b)y. 




{c{a) = b)^ [{c G m) V (3/ G ^ \{x : f{x) = c{x)}\ ^ ^)]] } 



^ £|v4||5| . 

Cmbicji 3TOH jieMMbi (xaK OHa npHMeHHexca) xaKofl. Bes orpaHHHeHna o6iii;hocth mojk- 
Ho npe^nojiaraxb, hto ceMeficTBO C npocToe (xax oGbihho, mojkho bsstb nepBoe b neKO- 
TopoM ecxecTBeHHOM nops^Ke ceMeiicTBo c hy^khbimh cBoiicTBaMH). BosbMeM b KanecxBe 
J-" ceMeiicTBO Bcex (|)yHKn;HH, HMeiomnx npocxtie nporpaMMbi (xoHHee, hx npo^ojiJKeHHH, 
ecjiH (|)yHKii;HH HacTHHHBi), a B KanecTBe S^{b) — ceMeiicTBO Bcex 4)yHKu;Hii, npocxtix 
oTHocHxejiBHo b. JXjis nap {a,b), ne Bxo^amHx b e-^ojiio "njioxHx", Haii^eTca rioKptiBa- 
lomaH HX (|)yHKn;Hii h3 ceMeiicTBa C. Bxa (|)yHKii,H5i (xoHnee, ee HH^eKc b C) m 6y^eT 
HyjKHbiM KOHTpnpHMepoM (HH(|)opMaii;HeH y npoTHBHHKa). EcjiH B ;];onojiHeHHe k c npo- 
THBHHK nojiynaex npocxyio nporpaMMy /, nepeBOflsmyio a b 6, to safl^anne a h tcm caMbiM 
b ynpomaeTca: ^ocTaxoHHO yKaaaxb nopa^^KOBbifi HOMep a b nepeHHCjieHHH Bcex peme- 
HHH ypaBHeHHH f{x) = c{x). BbiGpaHHoe naMH f), c ;i,pyroH cxopoHbi, rapaHTHpyex, hto 
c caMa no ce6e neaaBHCHMa c b (nMeex 6jiH3Kyio k MaKCHMajibnoil cjiojkhocxb flaace npn 
HSBecxnoM b). HoflpoGnee mbi CKaaceM npo sxo fl^ajihuie, a noxa ^OKaaceM jieMMy. 

/^OKaaameAhcmeo. B xanecxBe C bosbmcm cjiynannoe ceMeficxBO (J)ynKn;HH nyjKnoro paa- 
Mepa. (By;];eM CHHxaxb, hxo (|)yHKn;HH ns C nyMepyroxca HHCJiaMH ox 1 ;i,o n ^jia 
Ka>K;];oro noMepa i n Kaac^ofi xohkh a E A mbi nesaBHCHMO onpe^ejiaeM SHaneHHe i-fi 
4)yHKn;HH na a, BbiGnpaa paBnoBepoaxno o^nn h3 sjieMenxoB B.) ^oxajKeM, nxo Bepoax- 
nocxb xoro, nxo C "ney;];annoe", xo ecxb ne o6jia;];aex xpe6yeML.iM cbohcxbom, Menbme 1. 

On;enHM Bepoaxnocxb npn (jDHKcnpoBannoM ceMencxBe J-". HaM nyjKno, nxo6t.i 
jiioGoro na6opa ceMencxB ^ (c yKaaannbiMH b jieMMe orpannnenHaMn — Bce ceMencxBa 
ne 6ojiee nexBepxn C) ^jih nonxn Bcex nap (a, b) namjiacb 4)yHKn,H3 ns C, npoxo^Hn^aa 
nepea xonxy {a,b), ne saGpaKOBannaa ceMencxBOM J-" n ne Bxo^amaH b Sj{b). SaMexHM, 
nxo B onpe^ejiennn saGpaKOBannoii 4)ynKn;HH ne ynacxByex C: snaa J-", mbi y>Ke snaeM, 
KaKHe (|)ynKn;HH 6y^yx saGpaKOBanti. BosMoxcnti ^Ba cjiynaa: saGpaKOBanntix (|)ynKn;HH 
Mnoro (cKaaceM, Gojitme nexBepxn Bcex 4)ynKn;HH h3 C) h saGpaKOBanntix (|)ynKn;HH 
Majio (Mentme HexBepxn). Bo BxopoM cjiynae mbi MOJKeM npncoe^^nnnxB 3a6paKOBannt.ie 
(|)yHKn;HH ko BceM ceMencxBaM S^{b), n pasMep sxnx ceMeftcxB ocxanexca ne6ojibmHM (ne 
6ojibme nojioBHnbi \C\). 

/],pyrHMH cjioBaMH, ^jia ^annoro ceMencxBa J-" ney;];annocxB C noKpbiBaexca oG^hep^R- 
nenneM cjie^yion^nx flByx co6t>ixHH: 

1. J-" 6paKyex ne Menbme nexBepxn 4)ynKn,HH ns C; 

2. ^jia neKoxoporo naGopa i^, b KoxopoM Bce ceMencxBa Sj{b) hmciox pasMep ne Gojiee 
nojioeuHU \C\, jjpjis nap ns A x 5, nepea Koxoptie ne npoxo^nx nn o^na 4)ynKn;H5i 
c G C, ne Bxo^amaa b S^{b), npeBtimaex e. 

HaM nyjKno, htoGm cyiviMa Bepoaxnocxeii axnx flByx co6b.ixhh, yMnojKennaa na kojih- 
necxBO BOSMOJKnocxeii ^jih J-", 6t.ijia Mentme 1. /JoKaaceM, nxo BepoHxnocxt KajK^oro h3 
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HHx MeHbine 1/2, ;];ejieHHOH Ha ')* (nocjie^nee BbipajKeHHe — BepxHsa oii;eHKa na 

KOJiHHecTBo B03Mo>KHbix ceMeficTB T pasMepa He Gojiee $). 

IlepBoe coGbiTHe aannmeM b TaxoM bv^ji^: cyvnecmeyem maKoe nodceMeucmeo C d C 
pasjuepa \C\/4:, nmo Oah ecex c E C naudemcsi maKoe nodMHOcucecmeo A' (Z A pasMepa 
4:\A\/\B\ u maKasi (f}yHKii,uji / G J-", nmo f{a) = c{a) Bar ecex a E A' . 

KojiHHecTBO B03M0>KHt.ix C on;eHHM CBepxy o6iri;HM hhcjiom no^ceMeiicTB b C, to ecxb 
2''^!. IIpH (J)HKCHpoBaHHOM noflceMeftcTBe (xoHHee, ^jih ^anHoro MHOJKecxBa HH^eKcoB) 

(|)yHKIj;HH C 3THMH HH^CKCaMH Bt.l6HpaiOTC5I HesaBHCHMO, n03T0My MOJKHO OIJ,eHHTb BepO- 

axHocTB HejKejiaxejiBHoro co6t.iTH5i ^jia o^Hoii hs hhx h BosBecxH b cxeneHb. J\jisi ou;eHKH 
KOJiHHecTBa B03M0JKHL.IX no^MHOJKecTB A' saMeTHM, HTo HHCJio no^MHOJKecTB pasMepa r 
B MHOJKecTBe pasMepa g, to ecxt C^, He npeBocxo^HT g''/r! ^ / {{r /3Y) = (3g/r)''. 
Jinn q = \A\ H r = 4|74|/|i?| HOjiynaeM, hto KOJinnecTBO bosmojkhbix A' ne npeBocxo^HT 
(3|S|/4)4|^I/I^I. 

TaKHM o6pa30M, BepoaxHOCTt nepBoro co6t>iTHa ne 6ojibme 

'"H'f) (m) ) ^H'(i) ) ■ 

Ilocjie yMHoacenna na li?!'"^'* (hhcjio bosmojkhbix ceMeflcTB J-') ona ocxaexca Menb- 
me 1/2, nocKOJibKy no ycjioBHio jieMMbi \B\ ^ 2, |y4| ^ 16|-B|, $ ^ 2l'^l/^l^l h \C\ ^ 
6$|-B| log2 |-B|. /],eHCTBHTejibHO, H3 nocjie^Hero ycjioBHa cjie^yex, hto \C\ ^ 12 npn $ ^ 1 
(cjiynafi nycxoro J-" xpHBHajien) h \B\ ^ 2, nosxoMy 1 + |C| ^ 13|C|/12 h h3 1 ^ 
\A\/16\B\ cjie^yex, hxo 1 + \C\ ^ (13/192)(|A| |C|/|5|). Hs logs $ ^ l^l/4|S| cjie^y- 
ex, Hxo (|C|/4)log2<l> ^ (1/16)(|A||C|/|5|). HaKOHe^, hs \C\ ^ 6$|S| logs |S| cjie^y- 
ex, Hxo log2 |-B| ^ (l/6)(|/l||C|/|i?|). CKjia^biBaH sxh nepaBencxBa, aaMenaa, hxo 
19/64 < 1/3 < log2(4/3), H noxeHn;Hpya: o6e nacxH no ocHOBannio 2, nocjie rpynnnpoBKH 
coMHOJKHxejiefl nojiynaeM xpe6yeMoe nepaBencxBO. 

Hepeii^eM ko BxopoMy co6bixHio (nanoMKHM, oho saBHCHX ox J-", Koxopoe mm npe^- 
nojiaraeM cjDHKCHpoBaHHbiM) : cymecmeyem maKou Ha6op ceMeucme Sj = {Sj{b)}b^B, e 
KomopoM KacHcdoe ceMeucmeo S){b) UMeem pasMep ne 6oAee noAoeuHU \C\, u maKoe mho- 
CHcecmeo U G A x B pasMepa e\A\\B\, umo dnsi AmBou napu {a,b) E U u dnsi Am6ou 
(f)yHK-u,uu c E C, He npunadAecHcameu S){b), SHaneHue c{a) ne paeno b. 

3^ecb HaM Gyflex y^oGno cHHxaxb, hxo ceMeftcxBa S){b) cocxoax ne hs 4)yHKii,HH, a h3 
Hx HH^eKCOB (HHceji ox 1 j\o \C\). (Co6bixHe npn sxom ocxanexca xeM ace.) 

Hxo6bi oij,eHHXb BepoaxHocxb HHxepecyioin;ero nac ("bxoporo") coGbixna, 3a(|)HKCHpy- 
eM J-", H U . Tor^a cooxBexcxByiomee co6bixHe mojkho onncaxb KaK nepeceneHHe no 
BceM napaM (a, b) n no BceM i ^ coGbixnn c[i](a) 7^ b ("(|)ynKn;H5i noMep i b xonxe a 
He paBHa 6"). On;eHKa Gbijia 6bi npocxon, ecjin 6bi 3xh coGbixna 6bijiH nesaBHCHMbi: xor^a 
naflo 6bijio 6bi BOSBecxn (1 — l/|i?|) b cxenenb, paBnyio KOjinnecxBy Bcex xpoex {i,a,b), 
TO ecxb el^l • |S| ■ |C|/2. (Mbi yMHOJKHjin nncjio nap (a, b) E U na KOjinnecxBO BOSMoacHbix 
i flJiH ^annoro b.) Hpn pasnbix a (a xaxace npn pasnbix i) sxn coGbixna nesaBHCHMbi no 
nocxpoennio, no co6bixH3 c[z](a) 7^ 61 n c[z](a) 7^ 62 saBHCHMbi. Hac Bbipynaex xo, nxo 
saBHCHMOcxb xyx "b namy nojibsy" — xox 4)aKX, nxo mm anaeM, nxo c[z](a) 7^ bi, xojibKO 
yBejiHHHBaex BeposxHocxb coGbixHH c[2](a) 7^ 62 (snaMeHaxejib b 1/\B\ yMenbmaexcji na 
eflHHHn;y, anajiornnno n ^jih 6ojibmero KOjinnecxBa ycjioBnii). OopMajibno roBopa, mojk- 
Ho crpynnnpoBaxb coGbixna: c o^hhmh h xeMH xce a ni n BocnojibsoBaxbca nepabencxBOM 
(1 — k/\B\) ^ (1 — 1/\B\)'', r^e k — nncjio coGmxhh b rpynne. 
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TaKHM oGpasoM, mm nojiynnjiH BepxHioio oii;eHKy ^jia BepoaxHOCTH ney^aHH (npn 
(JjHKCHpoBaHHbix J"", S) H U): OHa He npeBocxo^HT 

. N e|yl||i?||C|/2 
1 - y— I j ^ 2~^l^ll^l/2. 

OcxaeTca yMHOJKHTt. sxy BepoHTHOcxb na KOJiHHecTBO MHOJKecTB U (hx He Gojibme 21"^' l"^'), 
Ha KOjiHHecTBO Ha6opoB (hx He 6ojiBme (2l''l)l-^l) h na KOjinnecxBO ceMeiicTB J-'. B 
peayjiBTaxe HOJiynHM 

2-£|A||C|/22|A||B|2|C||i?||^||A|<I>^ 

HeTpYflfio HpoBepHTB, HTo 3TO MeHBHie 1/2 HpH \B\ ^ 2, e ^ 4|i?|/|y4|, \C\ ^ 20\B\/e, h 
\C\ ^ (6$log2 I^D/e. AeficTBHTejiBHo, l + |yl||fi| ^ 3|A||fi|/2 npH nenycTOM Am \B\^ 2, 
HosTOMy H3 \C\ ^ 20\B\/e cjie^yex, hto 1 + \A\\B\ ^ (3/40)£|A| |C|. Hs 5 > 4|5|/|A| 
cjie^yex, hto |C||i?| ^ (l/4)£|y4| |C|. HaKOHen;, h3 \C\ ^ (6$ log2 l-BD/e cjie^yex, hto 
|y4|$log2 |-B| ^ (l/6)e|/l| |C|. CKjia^biBaji sth nepaBencTBa, saMenaji, hto 59/120 < 1/2, 
H noTeHH;Hpy5i o6e nacxH ho ocHOBaHHio 2, nocjie rpyiinnpoBKH coMHOJKHTejieH HOJiynaeM 
TpeGyeMoe HepaBencTBo. □ 

Tenept. mbi MOJKeM npHMeHHTt sto KOM6HHaTopHoe yxBepjK^eHHe h ^OKasaxt o6e- 
maHHbiH 0TpHH;aTejiBHt.iH pesyjibxax. 

IlycTB a > — HeKOTopaa KOHcxaHxa. Hycxt m, n, / — naxypajiBHtie HHCjia, hphhcm 
n^l,m^n + 4, m — a logg m ^ n + 2 H / + 1 + log2(/ + 1) ^ 2™-"-2. nOJIOJKHM 

= max{m, / }. 

TeopeMa 5. Uycmh danu CAoeo a Bauhu m u CAoeo b Oauhu n, npuueM 

m + n — KS^ (a, h) < a logg m. 
To2da Haudemcsi CAoeo c CAOMcnocmu n + I + 0{\ogN), Bah Komoposo 

• KS{c\b) = KS{c) + O(logiV); 

• KS{b\a,c) = 0{\ogN); 

• Bar aw6o30 f, npu KomopoM KS{f) ^ / — KS{b\a, f), eunoAHeno u KS{b\c,f) ^ 
m-n + KS{b\aJ) + 0{\ogN). 

{KoHcmaHma e O(-) aaeucum om a, ho ne om m, n u I.) 

06x.acHHM, KaKHM o6pa30M 3xa xeopeMa ^OKasbiBaex cyn];ecxBeHHOcxt> ycjioBHa b xeo- 
peMelH Hs paBencxBa KS{c\b) = KS{c) + O(logA^) Btixexaex, hxo b r c nesaBHCHMbi h 
KS{b\c) = KS{b) = n (c xohhocxbio O(logA^)). HocKojibKy KS{b\a,c) = O(logiV), xo 
H KS{a\c) ^ KS{b\c) — KS{b\a,c) = n (c xohhocxbio O(logA^)). OxMexHM eni;e, hxo 
KS{b\a) = n (c xohhocxbk) O(logm)). TaKHM o6pa30M, ecjiH KS{b\a, f) = 0{\ogN) ^jih 
HeKoxoporo cjioBa / ^jihhbi ne 6ojiee /, xo 

KS{b\c, f) < YmTi{KS{a\c), KS{b\c)} + O(logiV) 

HpH m — n < n + 0{\ogN), xo ecxt npn KS{a) < KS{b\c) + KS{b\a). 
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/J^OKasameAhcmeo. HycTb A — MHOJKecTBO Bcex cjiob ^jihhbi m, B — MHOJKecTBO Bcex 
cjioB ^jiHHbi n. BosBMeM e = 1/m" h $ = 2'"''^(/ + 1). Jlerxo yGe^HTbca, hto h3 ycjioBHii 
Ha n,m,l cjiepyeT, hto A, B, e r ^ y^^oBjiexBopaioT ycjioBH3M jicmmbi. HosTOMy ceMeii- 

CTBO C C yKaSaHHBIMH B JieMMe CBOHCTBaMH CymeCTByeX. ErO MOJKHO 3(|)(|)eKTHBHO HaflTH 

nepe6opoM, snaa A, 5, e h $, h nosTOMy cjiojkhoctb jiio6oro sjieMenxa C He npeBocxo^HT 
jiorapH(|)Ma HHCJia ajieMenxoB b C rijiioc O(logA^), to ecxt n + I + 0(logN). 

BosBMeM B KanecTBe S^{b) MHOJKecTBO {c G C: KS{c\b) < log2 \C\ — 2}. 5Icho, hto 

\m\ < ici/4. 

CeMeiicTBO 4)yHKn;HH J-" ctpohtch xax. Oho 6y^eT coctohtb h3 $ 4)yHKn;Hii, npony- 
MepoBaHHBix OT 1 ^o Mbi nepeHHCJiHeM Bce xpoiiKH (a, 6, /), r^e a & A, b & B n f — 
cjioBo fljiHHBi /, fljiH KOToporo KS {f) + if5'(6|a, /) ^ /. HpH stom neKoxopBie HOMepa 
(|)yHKii;HH HMeioT MexKH, aBjiaiomHeca cjioBaMH ^jihhbi /. Kor^a nosBjiaexca HOBaa xpoii- 
Ka (a, 6, /) , MBI nBixaeMCH ^oonpe;];ejiHXB b xoHxe a SHaneHneM b o^ny h3 4)yHKiJ,HH, y>Ke 
noMeHeHHbix MexKofl /. Ecjih Bce ohh yjKe onpe;];ejieHBi b xohkc a (h He paBHBi 6), mbi 
BBi6HpaeM HOMep, KoxopBifi eme ne noMenen, noMenaeM ero cjiobom / h nojiaraeM cJayHK- 
ii;hio c cooxBexcxByiomHM HOMepoM paBHofi b b xoHKe a. KaacflBifi pas CBoGoflHBiii (HHHeM 
He iioMeHeKHBift) HOMep Haft^excH, nocKOJiBxy ^jih xaJK^oro / nyacHO ne 6ojiee 2'"^"^*^-'^^+^ 
HOMepoB (ecjiH flJiH HeKoxoporo / noxpe6oBajiocB 6ojiBme, SHannx, ^jih neKoxoporo a Bce 
2i-KS{f)+i ^yjjj^y-jjg onpe^ejieHBi h npHHHMaiox pasHBie sHaneHna, xo ecxB mbi iiepennc- 
jiHjiH yjKe 2'~^'^('^)+^ pasHBix 6, ^jia KoxopBix i^'5'(6|a, f)^l — KS{f) — iipoxiiBopeHne), 
a flJiH Bcex / HyjKHO ne 6ojiee Y.KS{f)i:i 2^'^^^^^+'^ = Ylk=o Y.KS{f)=k 2'^^+^ = $ HOMe- 
poB. Hocjie xoro, KaK Bce xpoiiKH c yKasaHHBiM cbohcxbom nepenncjieHBi, ocxaBmneca 
Heonpe^ejieHHBiMH SHaneHiia (|)yHKii;HH ^oonpe^ejiaioxca npoHSBOjiBHO. 

PaccMoxpHM MHoacecxBO nap (a, 6), ne noKpBixBix C npn BBi6paHHBix T r S). Hx 
KOJiHHecxBO He npeBocxo;i;HX e2'""'"". C ;i;pyroH cxopoHBi, m Moryx 6bixb scJacJaeKXHBHO 
nocxpoeHBi c opaxyjioM 0', h no hhm scjDcJieKXHBno cxponxca MHOJKecxBO nenoKpbixBix 
nap, noaxoMy fljia jnoGoii nenoKpBixoii napBi KS^ (a, fe) ^ m + n — a logg m. 

TaKHM o6pa30M, ^jih jiio6bix cjiob a h fe, y KoxopBix m + n — < a logo m, 

nan^excH xaKoe c G C, nxo c(a) = b, c ^ S^{b) n ^jih jiio6oh / G KOjinnecxBO xaxnx 
X G A, nxo c(x) = f{x), ne 6ojiBme 2™^"+^. 

Hs c(a) = 6 cjie^yex, nxo KS{b\a,c) = 0{logN). 

Hs c ^ S){b) cjie^yex, nxo KS{c\b) ^ logs l*^! -2, to ecxB KS{c) = KS {c\b) + {log N). 

OcxajiocB on;enHXB KS{b\c,f) ^jia /, y KoxopBix KS{f) ^ / — KS{b\a, f). Snaa cjio- 
Bo /, 6y;i;eM nepenncjiaxB xe 4)ynKn;Hn ns J-", KoxopBie noMenenBi /. 0;i;na ns nnx, 
CKaJKeM, / co^epjKHX napy {a,b) (nnBiMH cjioBaMH, /(a) = b), fljia ee savanna ny>K- 
no ne 6ojiee KS{b\a,f) + 0(logA^) ^onojinnxejiBnBix 6hxob. TenepB no / n c Moacno 
nepenncjiaxb MnoJKecxBO xaxnx x, nxo c{x) = f{x). (Cxporo roBopa, npn noMoiii;H 
KS{b\a,f) + O(logA^) 6hxob mbi mojkcm aa^axB xojibko noMep / b ceMeiicxBe J-", a ne 
caMy Konennyio 4)ynKn;Hio. O^naKO ^jih nepenncjienna pemennii ypaBnenna c{x) = f{x) 
naM ^ocxaxonno xoro, nxo mbi mo^kcm nepenncjiaxB napBi (x, y), ^jih KoxopBix y = f{x), 
noBxopaa npon,ecc nocxpoenna J-".) 3xo MnojKecxBO co^epacnx a n cocxonx MaKCHMyM 
H3 2"^"""'"^ sjieMenxoB, n mbi mojkcm aa^axB a, saxpaxHB eni;e m — n + 2 6hxob. Hxoro, 
KS{b\c, /) ^ KS{a\c, /) + 0(log A^) ^ KS{b\a, f) + m-n + 0{\ogN), nxo n xpe6oBa- 

JIOCB. □ 

OTKptlTMe BonpocM. 
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1. MojKHo jiH B nocjie^Hefi TeopeMe yjiynniHTt. oii,eHKy, Bt.i6paB c cjiojkhocth n + 
0(log N) BMecTo n + I + 0(log N)7 (B cbocm ^oKjia^e Ah. A. MynHHK roBopHji, hto 
3TO BepHO, HO Tpe6yeT 6ojiee cjiojKHoro KOM6HHaTopHoro paccyjK^^eHHa, KOTopoe ne 
6l.ijio paccKasano). 

2. nocjieflH33 xeopeMa noKaatiBaeT, hto ecjiH a ne naMHoro cjiojKHee b, to npn neKO- 
TopoM c KopoTKHe ccKpeTHBie coo6iri;eHHH HeB03M0>KHt.i. B TO ace BpeMH ajiBTepna- 
THBHoe flOKasaTejibCTBO TeopeMBi [T] noKasbiBaeT, hto npn nycTOM c KopoTKHe ceK- 
peTHbie coo6iri;eHH3 Bcer^a bosmojkhbi. Mojkho jih yxasaTb KaKHe-To Kjiaccbi cjiob 

C, flJIH KOTOpblX BOSMOJKHBI H ^JIH KOTOptlX HeB03M0>KHL.I KOpOTKHC COoGmeHHS? 

3. Hto mojkho cKasaTB o bosmojkhmx cjiojkhoct5ix KS{f\b), KS{f\a,b), KS{f\a,b,c) 
^JI3 ceKpeTHbix /? 
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